Show Notes
Episode: Toby DiPasquale on Google, Map-Reduce, Hadoop, Amazon EC2 and more
Published: 2008-08-01
Toby covered a lot of ground. Here is a nice summer reading list.
Links.
- The Original MapReduce Whitepaper as one said, recently updated... by Jeffrey Dean and Sanjay Ghemawat.
- Google had Paul Erdos in mind when computing data for the search engines. Computing Your Erdos Number is an interesting read. Go to the main page to find out about Paul Erdos.
- For Hadoop, the Apache open source project, we find materials on The Apache Hadoop Web Site the sql like query language that can run Hadoop jobs.
- An alternate take on MapReduce--here is a Whitepaper on TheServerSide.com on doing MapReduce using Mule.
- Need to host in a cloud? Options abound; we discussed Amazon EC2 hosting and S3 Storage
- Side note - want to use S3 as a disk drive? A few of us around here are using JungleDisk on OS X. Seems to beat iDisk in terms of performance and reliability.
- Toby recommended learning Erlang as it is built for concurrent programming. Windows programmers rejoice as it comes in a precompiled binary. OS X users have a Darwin Port available with sudo port install erlang and apt-get on linux supposedly has an erlang and erlang-base.
- Somewhere along the way, Toby mentioned Leslie Lamport and the Paxos Algorithm
- Toby has a great personal website, the Cipher Block Chain Gang where he keeps his presentations, blogs and other notes.
