You have been invited to the following event.Turning the database inside-out - Discussion
The Data Engineering and Architecture teams are hosting a watch party for a talk given by Martin Kleppmann about how event streams can be used to build more flexible data systems. This event is the discussion of the talk. Attendees are expected to have watched the talk (and/or read the blog post) before hand, either on their own or at the optional Watch Party. Discussion Notes Turning the database inside-out*Databases are global, shared, mutable state. That’s the way it has been since the 1960s, and no amount of NoSQL has changed that. However, most self-respecting developers have got rid of mutable global variables in their code long ago. So why do we tolerate databases as they are? A more promising model, used in some systems, is to think of a database as an always-growing collection of immutable facts. You can query it at some point in time — but that’s still old, imperative style thinking. A more fruitful approach is to take the streams of facts as they come in, and functionally process them in real-time. [...]At its core is a distributed, durable commit log, implemented by Apache Kafka. Layered on top are simple but powerful tools for joining streams and managing large amounts of data reliably. What do we have to gain from turning the database inside out? Simpler code, better scalability, better robustness, lower latency, and more flexibility for doing interesting things with data. After this talk, you’ll see the architecture of your own applications in a new light. *This talk mentions Apache Samza, but the specific framework is not relevant. Any modern Stream Processing framework would do. Going (wikimedia-search@lists.wikimedia.org)? | ||||||||||||||||||||
Invitation from Google Calendar You are receiving this courtesy email at the account wikimedia-search@lists.wikimedia.org because you are an attendee of this event. To stop receiving future updates for this event, decline this event. Alternatively you can sign up for a Google account at https://calendar.google.com/calendar/ and control your notification settings for your entire calendar. Forwarding this invitation could allow any recipient to send a response to the organizer and be added to the guest list, or invite others regardless of their own invitation status, or to modify your RSVP. Learn More. |