Twisted, AMQP and Thrift: Bridging messaging and RPC for building scalable distributed applications (#40)
Esteve Fernandez (Fluidinfo Ltd.)
30min ◊◊◊ Advanced
Friday 02:30pm, Ballroom E
categories:
library, network, twisted
In building our new online database at Fluidinfo, we needed scalable and reliable messaging/RPC for a system of heterogeneous services. We chose two proven open-source components, AMQP and Thrift, and adapted these to work with Twisted asynchronous networking.
The result - also open source - is a simple, general, and flexible system for connecting the components of a complex distributed application. With a message broker at its core, it provides for scaling, replication, load balancing, and distributed transactions. It also transparently handles returning exceptions and Twisted Deferreds from remote services.
I'll describe architecture, example code, benchmarks, advantages, and alternate approaches.
The result - also open source - is a simple, general, and flexible system for connecting the components of a complex distributed application. With a message broker at its core, it provides for scaling, replication, load balancing, and distributed transactions. It also transparently handles returning exceptions and Twisted Deferreds from remote services.
I'll describe architecture, example code, benchmarks, advantages, and alternate approaches.
Files:
| file | size | uploaded | comment |
|---|---|---|---|
| esteve-fernandez-twisted-amqp-thrift.odp | 497.0 KB | Sat, March 28th, 6:25 p.m. | OOo Version |
video:
# Permalink
.