akka/akka-core

Provide mechanism for detecting Cluster singleton failures and cluster sharding start failures

Open

#19,823 opened on Feb 18, 2016

View on GitHub
 (1 comment) (0 reactions) (0 assignees)Scala (13,277 stars) (3,547 forks)batch import
1 - triagedhelp wantedt:cluster-shardingt:cluster-tools

Description

as discussed: https://groups.google.com/forum/?fromgroups=#!topic/akka-user/_PJtBMzKuAk

Sounds good to publish this on the event bus. It's a fatal error that will not repair itself, so one could claim that we should stop the actor system, but that might be too harsh.

so some failure event should be published when shard coordinator fails to start similar for cluster singleton - when it is stuck, also event can be published

that would allow app monitoring logic to catch failure situation and act upon it

Contributor guide

Tech stack
scala
Domain
backendobservability
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
5
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
over 1 week
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
Akka ClusterAkka ShardingEvent bus in Akka
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
15
Research direction
Examine the ClusterSingletonManager and ShardRegion actor implementations in the akka core source to identify points where startup failures occur. Review the existing event bus usage (akka.event.EventBus) to understand how to publish failure events. Consider the discussion in the linked Google Groups thread for design decisions. Implement an event type for singleton and shard failures, and publish it on the event bus when the coordinator fails to start or the singleton becomes stuck.