containous/leadership

Name: leadership

Owner: Containous

Description: Distributed Leader Election using docker/libkv

Forked from: docker/leadership

Created: 2017-11-13 14:28:36.0

Updated: 2017-11-13 15:22:09.0

Pushed: 2018-01-23 13:56:46.0

Homepage: null

Size: 27

Language: Go

GitHub Committers

UserMost Recent Commit# Commits

Other Committers

UserEmailMost Recent Commit# Commits

README

Leadership: Distributed Leader Election for Clustered Environments.

Leadership is a library for a cluster leader election on top of a distributed Key/Value store.

It is built using the docker/libkv library and is designed to work across multiple storage backends.

You can use leadership with Consul, etcd and Zookeeper.

reate a store using pkg/store.
nt, err := store.NewStore("consul", []string{"127.0.0.1:8500"}, &store.Config{})
rr != nil {
panic(err)


rwood := leadership.NewCandidate(client, "service/swarm/leader", "underwood", 15*time.Second)
tedCh, _ := underwood.RunForElection()

isElected := range electedCh {
// This loop will run every time there is a change in our leadership
// status.

if isElected {
    // We won the election - we are now the leader.
    // Let's do leader stuff, for example, sleep for a while.
    log.Printf("I won the election! I'm now the leader")
    time.Sleep(10 * time.Second)

    // Tired of being a leader? You can resign anytime.
    candidate.Resign()
} else {
    // We lost the election but are still running for leadership.
    // `elected == false` is the default state and is the first event
    // we'll receive from the channel. After a successful election,
    // this event can get triggered if someone else steals the
    // leadership or if we resign.

    log.Printf("Lost the election, let's try another time")
}

It is possible to follow an election in real-time and get notified whenever there is a change in leadership:

ower := leadership.NewFollower(client, "service/swarm/leader")
erCh, _ := follower.FollowElection()
leader := range leaderCh {
// Leader is a string containing the value passed to `NewCandidate`.
log.Printf("%s is now the leader", leader)

Fatal("Cannot follow the election, store is probably down")
ecovery code or exit

A typical use case for this is to be able to always send requests to the current leader.

Fault tolerance

Leadership returns an error channel for Candidates and Followers that you can use to be resilient to failures. For example, if the watch on the leader key fails because the store becomes unavailable, you can retry the process later.

 participate() {
// Create a store using pkg/store.
client, err := store.NewStore("consul", []string{"127.0.0.1:8500"}, &store.Config{})
if err != nil {
    panic(err)
}

waitTime := 10 * time.Second
underwood := leadership.NewCandidate(client, "service/swarm/leader", "underwood", 15*time.Second)

go func() {
    for {
        run(underwood)
        time.Sleep(waitTime)
        // retry
    }
}()


 run(candidate *leadership.Candidate) {
electedCh, errCh := candidate.RunForElection()
for {
    select {
    case isElected := <-electedCh:
        if isElected {
            // Do something
        } else {
            // Do something else
        }

    case err := <-errCh:
        log.Error(err)
        return
    }
}

License

leadership is licensed under the Apache License, Version 2.0. See LICENSE for the full license text.


This work is supported by the National Institutes of Health's National Center for Advancing Translational Sciences, Grant Number U24TR002306. This work is solely the responsibility of the creators and does not necessarily represent the official views of the National Institutes of Health.