Skip to content

It’s all about Culture - Devopsday, Rome

2012 September 11

It’s that time of year again: Devopsdays Europe is on, four years after the original Devopsdays conference in Gent that got the movement started. The second event was in Hamburg, last year’s conference in Gotheborg, and this year’s location is Rome.

With talks covering the whole devops spectrum, including culture, automation and measurement, lots of people will be sharing their experiences. Speakers for this year’s European edition include Damon Edwards, Jason Dixon , Bryan Berry and Mark Burgess.

Let me introduce you to Alessandro Franceschi, one of the Italian devops evangelists. Al has been active in the Puppet and devops communities for a couple of years now and is one of the people organising the Rome event, so we asked Alessandro a couple of questions.

Q: After Gent, Hamburg and Gotheburg, the European Edition of Devopsdays is now coming to Rome. What makes Rome the perfect place to discuss Devops?

A: In conferences like DevOps Days you go to share ideas, learn new things and meet friends. Rome is a great place for all of these things… and it has many benefits like hopefully nice weather, remarkable sightseeing and good Italian food. This choice happened almost by chance - from just a few discussions to some tweets the location was decided, but to be honest, I think that Patrick, Kris and the other main organisers just wanted to have an excuse to visit Rome (again!)…

We will talk about and discuss tools, processes, people and culture, we will learn how others face our same problems or know about problems we never thought we might have. But there will be a large focus on how the “DevOps way” involves and drives a cultural shift in how people collaborate within a company. “It’s all about Culture” is this edition’s headline, and Rome is a really appropriate location to talk about this.

Q: Alessandro, you’ve been pretty active in the devops / puppet community for a couple of years now. Can you tell us a bit about the local Italian scene?

A: Italy is a haven for talented IT geeks. Many are curious and explore trends and technologies way before the companies where they work. Communication frictions, work organisation in silos, established rigidities are still dominant.

At the same time a vital and active startup community is growing larger and larger: it sparkles with vitality and hope amid the depressing fogs of the crisis. Here DevOps adoption is easier, if not plain necessary. There’s interest both from the dev side (where Agile adoption is well established) and from the Ops side (mostly driven by automation needs). Puppet is growing fast and there are various Chef users as well: numbers are still relatively low but the trend is evident.

Q: The schedule is almost finished, what are you most looking forward to?

A: Many of the presentations seem quite promising. The quantity and quality of the proposals were good.
I’m personally looking forward to learn about Damon Edwards’s “levers for change” for DevOps Culture adoption and quite interested in Chris Hilton’s talk “Beyond Continuous Delivery”. I’m also curious on Bryan Berry’s “Monitoring data.fao.org” and Jason Dixon’s “The State of Open Source Monitoring: The good, the bad, the fucking terrible, and a glimpse into our future”. In any case I’m quite sure that I’ll also find enlightening or interesting ideas in more unexpected places. There will be a good number of Ignites, a format that I personally love. But it’s the people who make the event, so I expect vibrant open space discussions and long evening followups accompanied by great beer.

Besides the actual contents of the conference we hope to provide a really nice experience to the participants. We expect an excellent catering service and the location, kindly sponsored by IBM Italy (I want to mention them without reservation because they have been really helpful in making this edition possible), looks a very interesting and unusual place.

Q: What else besides devopsdays should people visit Rome/ Italy for ?

A: Rome is an incredible city. If you have been there, you know what I mean. You walk over history with every step you take, you turn around a corner and see something new: a church, some ruins or monuments that might be 2000, 200, 50 years old. It reflects the past virtues and current vices of Italy, with all their contradictions. We plan to propose an informal city tour, the day after the event, to the DevOps who want to chill out together by visiting the town after 2 days of brainstorms

With DevOps from all over Europe, Rome’s charm, Italy’s way (and no more political jokes that are a reality), this is Devops Days.

It’s all about Culture!

 

Kris Buytaert is a long time Linux and Open Source Consultant. He’s one of instigators of the devops movement, currently working for Inuits.

Kris is the Co-Author of Virtualization with Xen ,used to be the maintainer of the openMosix HOWTO and author of different technical publications. He is frequently speaking at, or organizing different international conferences

He spends most of his time working on Linux Clustering (both High Availability, Scalability and HPC), Virtualisation and Large Infrastructure Management projects hence trying to build infrastructures that can survive the 10th floor test, better known today as the cloud while actively promoting the devops idea !

His blog titled “Everything is a Freaking DNS Problem” can be found at http://www.krisbuytaert.be/blog/.

What’s your favourite sysadmin related book?

2012 September 7

I own many sysadmin books but my favourite has to be Linux System Programming by Robert Love. It’s not always been my favourite of course, there will always be a special place in my heart for Unix Power Tools, if only for getting me past that initial “Write us a Unix shell script”, “no problem, what’s Unix?” moment in my first job, but that’s been pushed into second place by Robert Love’s book.

It’s not because I have any great expertise in C, or any great desire to write low level system code – I’m a mediocre programmer at best. It’s because it is the best book I know for those who want to actually understand how Linux works.

There are many books on administrating Linux boxes, most of them start with a “how to install” chapter. It’s been a long time since I needed one of those. Many of them continue with a tour of some of the GUI-based admin applications that exist. I don’t install X-windows on servers. Then they continue with an introduction to the command line and a tour of some useful commands. I know all the grep options I’ve ever required, and I can use a manual page as well as any other 15 year veteran CLI [command line interface] user. Basically these books have no appeal to me anymore, and I’m no longer their target market.

But once you move beyond the introductory books you hit a problem. The only other type of books that exist for the sysadmin are the application specific ones covering Bind or Tomcat or Apache or one of the many other applications we admin. These are of course fantastically useful if you want to admin Bind or Tomcat or Apache, but they’re pretty much useless if you don’t. If you want to get all business speak about it they address a vertical market, not a horizontal one.

What makes Linux Systems Programming so useful to me is the sheer amount of background information he has put into it. Each chapter contains big chunks of general information related to the topic of the chapter before he wanders off into the C functions that address it. So, for example, the chapter on “Advanced File I/O” contains descriptions of the various IO schedulers available and how and why you might want to use them. The “Advanced Process Management” section contains a good introduction to real-time, and “File and Directory Management” talks about extended attributes (heavily used by SELinux and Gluster) the way ext3 and xfs implement them and the restrictions they impose.

What this book gives me, and what no other book I’ve been able to find does (with the possible exception of Unix Power Tools) is the background information I need to make me a better Linux admin: not an Apache admin, or a puppet admin, but a Linux admin.

It’s not without its flaws of course, it’s at heart a book about C programming, and its value to a sysadmin is serendipitous rather than intentional – so many things you’d like to know aren’t covered (extended attributes are explained but not how to manipulate them from the command line for example), and there are large sections that are of little interest to the non-programmer. But when it’s good, it’s by far the best book out there.

It seems very strange to me that to get this kind of detailed knowledge I have to buy programming books, but when you think about it, there really aren’t any advanced sysadmin books on the market. Contrast this with the programming book market, taking Perl as our example. You can start with Learning Perl, move on to Intermediate Perl, study Advanced Perl, and somewhere along the way read Programming Perl and a dozen other books about different aspects of the language, and if you want to take it even further you can read many books about code style, algorithms or even the lofty heights of The Art of Computer Programming.

But where are the intermediate or advanced level sysadmin books? Where are the books that talk about performance tuning the OS, laying out RAID, the pros and cons of different file systems for your workload, (or even just figuring out what your “workload” actually means), the what, when and why (and why not) of configuring HugePages and the thousand and one other topics that deal with the fundamental ways Linux operates that we deal with every day as part of our jobs, but about which we never gain the deep understanding that perhaps we should.

This sort of information is out there: if you hunt around on the web you can find dozens of blog posts and howtos (many contradictory and outdated of course, this is the web after all!) on any of these subjects, but if you’re looking for a single cohesive description of the OS we make our livings at, sorry, you’re out of luck. This is a shame because the more you understand your job the better you’re going to be, and the easier you’re going find fixing the next weird and unusual problem (in fact the less likely you are to have a weird and unusual problem because you’ve anticipated it and fixed it before it had a chance to set off the pager).

Maybe it’s just me but these sorts of details are just plain fun, both as an end in themselves and as a way of showing off just how awesome you are to your comrades. We all know that sysadmins are the true elite of the computer world, so the better a sysadmin you can be, the more you truly understand Linux, then obviously the better the person you are!

So go and have a look at Robert’s book, it may make you a better sysadmin and a better person. I hope so because it’s the only choice you have.

Chris studied astrophysics at university but drifted into Unix when he finally accepted he was never going to get a job as a spaceman. After a brief stint working with Digital Unix he installed Red Hat 5.0 from a magazine cover disk and has never looked back. In the 15 years since then he’s alternated between sysadmin and consultant roles and is is currently a consultant with Red Hat.

 

 

State of the Embedded Market

2012 September 4

The embedded market has always played an important role in the decision making process of industrial firms and that importance is growing every year.

Many companies use real-time systems, require electronic design or develop custom firmware; the choice of tools and software is driven by experience, background and different mindset.

There are 4 fundamental aspects that influence those choices:

  • Open source: often neglected for fear or uncertainty about the licenses, it’s a great resource of software and libraries
  • Hardware: which are the most popular microcontrollers, what are the parameters relevant to hardware’s choice and which are the most important information sources.
  • Software Development: what OS / IDE / Tools are common, why are they chosen, what are the most important features, which libraries are popular and what is their life cycle inside the project.
  • Real-Time OS: which is the most popular? Do they bring real benefits or are they too complex? What is the best choice between a commercial or open source RTOS solution? What are the expectations on an RTOS?

Currently, the embedded industry is lacking a well defined identity. Embedded development is usually split in two competing camps, the pure hardware field and the software field. On the contrary, typical problems can be optimally solved only with a synergy of skills and technologies from both camps.

That is still not clear, at least in the Italian market, where the approach is often simplistic or, worse still, focused only on one of the two components.

This is the premise that pushed us to create Better Embedded, the first Italian conference dedicated to embedded development. The conference was born from a very simple need: to broaden the training in embedded in Italian territory and thereby increase the quality of the products.

The event will cover advanced topics, introducing and explaining in collaboration with national experts and excellent companies, the latest news and best practices for developers and designers, what’s on offer, what are the dynamics of the product, which are technologies with which you can develop and improve your idea and your project.

Particular attention is given to open source solutions, an important opportunity for the embedded industry, yet little appreciated in our country, to the exclusion of excellent projects like Arduino.

The conference is a great opportunity for professional training and to build new relationships with customers and partners in the market.

In its very first year, the event is organized by Develer Srl, a company engaged in the design and development of high quality software and hardware, also known for its experience in organizing training events of great thickness like:

  • Europython, the European Conference on Python (to be held this July again in Florence)

If you like the sound of this, then sign up for one or both days, and I look forward to see you in Florence!

 

Since 2009 Francesco Pallanti is the man behind all the conferences organised by Develer; he does not shave too often, plays guitar in a rock band and drives a Speed Triple around the Tuscany montain pass.

Hardware Hacking for iOS Programmers

2012 August 30

The arrival of the iPhone changed the whole direction of software development for mobile platforms, and has had a profound impact on the hardware design of the smart phones that have followed it.

Not only do these devices know where they are, they can tell you how they’re being held, they are sufficiently powerful to overlay data layers on the camera view, and record and interpret audio data, and they can do all this in real time. These are not just smart phones, these are computers that just happen to be able to make phone calls.

Alasdair demonstrating an Augmented Reality application

The arrival of the External Accessory Framework was seen, initially at least, as having the potential to open the iOS platform up to a host of external accessories and additional sensors. Sadly, little of the innovation people were expecting actually occurred, and while there are finally starting to be some interesting products arriving on the market, for the most part the External Accessory Framework is being used to support a fairly predictable range of audio and video accessories from big-name manufacturers.

The reason for this lack of innovation is usually laid at the feet of Apple’s Made for iPod (MFi) licensing program. To develop hardware accessories that connect to the iPod, iPhone, or iPad, you must be an MFi licensee.

Unfortunately, becoming a member of the MFi program is not as simple as signing up as an Apple Developer, and it is a fairly lengthy process. From personal experience I can confirm that the process of becoming an MFi licensee is not for the faint-hearted. And once you’re a member of the program, getting your hardware out of prototype stage and approved by Apple for distribution and sale is not necessarily a simple process.

However all that started to change with the arrival of Redpark’s serial cable. As it’s MFi approved for the hobbyist market it allows you to connect your iPhone to external hardware very simply, it also allows you to easily prototype new external accessories, bypassing a lot of the hurt you experience trying to do that wholly within the confines of the MFi program.

Another important part of that change was the Arduino. The Arduino, and the open hardware movement that has grown up with it and to a certain extent around it, is enabling a generation of high-tech tinkers to prototype new ideas with fairly minimal hardware knowledge.

Every so often a piece of technology can become a lever that lets people move the world, just a little bit. The Arduino is one of those levers. While it started off as a project to give artists access to embedded microprocessors for interactive design projects, I think it’s going to end up in a museum as one of the building blocks of the modern world. It allows rapid, cheap prototyping for embedded systems. It turns what used to be fairly tough hardware problems into simpler software problems.

Turning things into software problems makes things more scalable, it drastically reduces development time scales, and up front investment, and as the whole dot com revolution has shown, it leads to innovation. Every interesting hardware prototype to come along seems to boast that it is Arduino-compatible, or just plain built on top of an Arduino.

Arduino being controlled from iPad

Controlling an Arduino directly from the iPad

I think the next round of innovation is going to take Silicon Valley, and the rest of us, back to its roots, and that’s hardware. If you’re a software person the things that are open and the things that are closed are changing. The skills needed to work with the technology are changing as well.

Alasdair Allan talking at a workshop

Alasdair presenting at a master class on Augmented Reality

At the start of October I’ll be running a workshop on iOS Sensors and External Hardware. It’s going to be hardware hacking for iOS programmers, and an opportunity for people to get their hands dirty both the internal sensors in the phone, and with external hardware.

The workshop is intended to guide you through the start of that change, and get you hands-on with the hardware in your iPhone you’ve probably been ignoring until now. How to make use of the on-board sensors and combine them to build sophisticated location aware applications. But also how to extend the reach of these sensors by connecting your iOS device to external hardware.

Blinking the heartbeat LED of a BeagleBone from the iPhone

We’ll look at three micro-controller platforms, the Arduino and the BeagleBone and Raspberry Pi, and get our hands dirty building simple applications to control the boards and gather measurements from sensors connected to it, directly from the iPhone. The course should give you the background to build your own applications independently, using the hottest location-aware technology yet for any mobile platform.

The workshop will be on Monday the 8th of October at the Hoxton Hotel in London at the heart of Tech City, and right next to Silicon Roundabout. I’m extending a discount to readers; 10% off the ticket price with discount code OREILLY10. That makes the early bird ticket price just £449.10 (was £499), or if you miss the early bird deadline (the 1st of September) a full priced ticket still only £629.10 (£699).

Alasdair Allan is the author of Learning iOS Programming, Programming iOS Sensors, Basic Sensors in iOS, Geolocation in iOS, iOS Sensor Apps and Arduino and Augmented Reality in iOS. Last year he and Pete Warden caused a privacy scandal by uncovering that your iPhone was recording your location, all the time. This caused several class action lawsuits and a U.S. Senate hearing. He isn’t sure what to think about that. From time to time he stands in front of cameras, and you can often find him at conferences run by O’Reilly Media. He runs a small technology consulting business writing bespoke software, building open hardware and providing training, including a series of workshops on sensors. He sporadically writes blog posts about things that interest him, or more frequently provides commentary about them in 140 characters or less. Alasdair is also a senior research fellow at the University of Exeter. As part of his work there he built a distributed peer-to-peer network of telescopes which, acting autonomously, reactively scheduled observations of time-critical events. Notable successes included contributing to the detection of the most distant object yet discovered, a gamma-ray burster at a redshift of 8.2.

Oggcamp 2012

2012 August 27

Oggcamp, now in it’s fourth year, has firmly established itself as “The” unconference for those interested in open source hardware and software. This year’s venue, was the fantastic John Moores University building, which provided fantastic facilities for the Oggcamp organisers.

Provided, and authorised by Tris Linnell

Provided, and authorised by Tris Linnell

Oggcamp, for the first time had a fringe event. Called the “Open Hardware Jam”, it was a chance for hardware hackers and makers to meet and learn new skills from each other. There were many makers there, from the latest sewing technology (producing fantastic custom t-shirts and baseball caps) to the Raspberry Pi being sold to eager delegates.
The Jam was a great chance to get hands on and learn new skills, many delegates learning to build devices using Nanode, Arduino and Fignition. 3D printers, were also present, different types producing all manner of custom made curios.

The heart of Oggcamp is the unconference, this year with 4 tracks, 3 for the unconference, and 1 track for a great list of scheduled speakers. Unconferences are always fun, you never know what talks you will get, and Oggcamp certainly does not disappoint. We had talks about programming, podcasts and the future of our children’s ICT learning in schools. There was also a lightning talk session added to the schedule, to allow for fast paced talks.

Crowd shot - Provided and authorised by Fabian Scherschel

The event has grown in four years, from a small hotel in Wolverhampton for the first Oggcamp, to a large University building in Liverpool for this year. The momentum that Oggcamp generates, before and after the event is immense, with lots of projects being created and demonstrated at the event. With so many people in attendance, it is easy to reach out and work with like minded people.

 

 

Crew shot - Provided and authorised by Tony Whitmore

 

My thanks to the organisers, especially Dan Lynch, for their sheer hard work in making this event happen.
Special thanks to my crew, it was my pleasure to be your “Chief”, you all worked extrememly hard, and I am proud of you.

 

Fab Lab - Frankenstein Garage

2012 August 14

So what are these fab labs of which people have been speaking about so much lately? As Wikipedia puts it, “The fab lab program was started in the Lab at MIT, a collaboration between the Grassroots Invention Group and the Center for Bits and Atoms (CBA) at the Massachusetts Institute of Technology, broadly exploring how the content of information relates to its physical representation, and how a community can be powered by technology at the grassroots level”.

One of our students playing with a microcontroller

The program grew out of a popular class at MIT called “How to make (almost) anything” thanks to Professor Neil Gershenfeld, who realized that academic education was heavily centered on theory and his students could barely screw in the proverbial light bulb. In one of his speeches he said that at the time he thought “Will the MIT allow me to teach these things? Won’t they be too useful?”.

Paolo aka our R&D department

Anyway, a fab lab is a fabrication laboratory, i.e. a lab equipped with digital technologies in which people can meet and build, almost anything. The term fab lab can also be interpreted as “fabulous laboratory”, for the almost magical way in which you can design a digital model on a computer and automagically transform it into a real and almost living object. Actually, the vast majority of projects startsout on the back of a napkin before they evolve into more and more precise models, which will then be the basis of the first prototype. This is good, because it means that anybody can start a brilliant project, all they need is a little nudge and someone as passionate who can help them.

Frankenstein Garage is a fab lab, if a very small one yet. Frankenstein Garage was born in May 2011 in front of a coffee machine - one of the most dangerous places in the world because it can host conversations that can lead you to the most strange and unimaginable places and situations. Which is exactly what happened to us.

The tweet-o-meter and the green station we used during the Barcamper tour

“Us” basically means Paolo and me, even though one of the mantras about starting a new grassroots fab lab sounds more or less like “the more, the better”. Paolo is a very creative and passionate electrical engineer, while I… well, I write posts for Josette G. We lived in front of each other before realizing that we shared a lot of passions and interests, and so it was only natural that we started collaborating. Before we started the famous conversation at the coffee machine we tried other different projects, which failed but taught us a lot. And now here we are.

Setting up for a workshop in a library

The official list of the tools for a fab lab leads to an initial investment of about $180.000. The crisis which is storming over Italy and Europe at large makes it very difficult for everybody to start out with such an investment, and this is even truer for us as we started out of nothing. So, how can you launch a startup during such a difficult time? We are following the theories by Steve Blank, Alex Osterwalder, Eric Ries, Josh Kaufman and many others.

"La sciura Maria" as seen by Rafal "Fifek" Bigda

Theories that always hold up, even in happier times because they focus on finding an actual working and healthy business model before putting on a money-eating monster. This is why we started even without a venue, just collaborating with different projects of the international fab lab network.After that, as knowledge sharing is a very important part of the philosophy of fab labs, our MEVO (minimum economically viable offer) was education, with the “sciura Maria” courses in which we teach the foundations of electronics, microcontrollers programming, processing, and 3D printing.

Physical computing: all around you

Also, we have had the great pleasure of speaking at conferences like WhyMCA, Italian Agile Day and Codemotion. Meanwhile, leaning on other established labs, we have helped people to realize their projects in a perfect fab lab style. Now it seems we have a venue, even if Italian bureaucracy and the costs of insurance do not help those who wants to start a business of their own, so we hope to have the fire extinguishers of the proper color as soon as possible.

Anyway, if you are interested in starting a grassroots fab lab of your own, you can attend FABFUSE 2012 which will be held in Amersfoort (NL) from 8th to 11th August - sorry you have to wait until next year. Also, do not miss the Makers Italy fair which will be held near Milan from 9th to 11th of November. Bring your ideas with you, we’ll be longing to hear them. So… what is your idea? And what are you waiting for?

Andrea Maietta (@andreamaietta) Passionate supporter of agile methods despite his three digits weight, he passed from the role of scrum half to that of Scrum master, even if his true love remains the back row. He’s cofounder of Frankenstein Garage, the first (would be) fab lab in Milan, where he tries to build a lightsaber while he’s busy keeping the geeks of the lab down to earth. Every now and then he rants on [http://andreamoz.blogspot.com].

Paolo Aliverti (@zeppelinmaker) He shares his many interests, which comprise business, management and technology, on his blog. LEGO, electronics and IT have been his biggest passion since he was in the cradle (but don’t tell his wife). He’s cofounder of Frankenstein Garage, where he puts his experience on physical computing to good use leading courses on electronics and microcontrollers.

 

Functional Programming in 2012 … time to learn something more?

2012 August 9

Functional programming ideas have been around longer than computers: Church’s lambda-calculus was invented in the 1930s as a way of describing computations as functions around the same time that Turing was describing what an idealised (human) “computer” could do through Turing machines. The idea of using functions as the primary means of computing fed straight into Lisp and its (LAMBDA …), ideas of procedures in Algol68, but settled into what people now call functional languages in the late 1980s, with the definition of ML, Haskell and Erlang.

Erlang - which is really a language for high-concurrency, fault-tolerant, robust systems - is based on functional ideas because it’s so much easier to write concurrent systems when every assignment is a single assignment (check out Single Assignment C too). Haskell and ML (and also OCaml, SML, …) are general purpose languages where types do much of the heavy lifting for you: types are inferred from what you write, and if you have got a program that type checks then you’ve ironed out a whole class of errors before running a single instruction.

As I’ve said, these languages were first defined more than twenty years ago, so what are the modern functional programming languages? One answer is Java, and other mainstream languages, which are taking on more and more functional features. Using immutable data is inherited from the functional world, as were Java generics. Coming soon are closures - yes, that’s right, LAMBDA in Java! So you can do functional programming in Java (and O’Reilly have recently published Functional Programming for Java Developers: Tools for Better Concurrency, Abstraction, and Agility).

But what if you want to try the real thing? A first choice is F#, which puts a functional language into the .NET framework as a first-class citizen, with internationalization, intellisense, and full integration with C# and the .NET libraries. One of the ways of getting started with F# is to use it to explore some of the library APIs, executing calls interactively. Extending Java to give a fuller functional language, as well as Erlang-style concurrency, is Scala. From Scala too, there’s access to the Java libraries, as well as execution on the JVM. Finally, it’s worth taking a look at Haskell, which is functional first, but which provides controlled access to concurrency, IO, exceptions and a wealth of open source libraries.

At CUFP 2012 you can find tutorials on F#, Scala (1 day each) and Haskell (2 days) designed to give you an introduction to the functional style of programming even if you’ve never used a functional language, this is a chance to find out more.

But, why bother, you might say? One reason is sheer curiosity: you’ll find out what all the fuss is about, and see where ideas like map-reduce come naturally out of the programming style. It also give you a different way of attacking problems: even if you’re going to be programming in Java, then a functional style might well give you a different tool to solve the problem at hand.

Another reason is to get a job (really!). How are functional languages getting used? Erlang and Scala support high-throughput message handling and web systems, and are the “secret weapon” behind applications supporting Facebook, Amazon and other systems. Haskell gets used in building domain-specific languages in security, crypto and increasingly in the financial sector, where F# is getting traction too. You’ll see a steady stream of jobs calling for Erlang, Haskell, Scala, F#, as well as for people who are happy using one of these languages and C, or Java or whatever, because functional languages often come in as a solution to part of a problem, rather than solving the whole thing.

If you like the sound of this, then sign up for one of the tutorials at CUFP, and I look forward to seeing you there!

My main research interests are in functional programming, most recently to help people to write programs more effectively. In particular, together with Huiqing Li I have been working on building refactoring tools for functional programs in Erlang and Haskell, supported by EU and EPSRC funding. I have also worked in reasoning and multimedia. I have written four books on Functional Programming including Erlang Programming with Francesco Cesarini and Haskell: the Craft of Functional Programming - Simon Thompson, Professor of Logic and Computation, University of Kent

 

No YAPC !

2012 August 1

I am suffering from a lack of Perl – maybe not the language but definitely the community. As far as I can remember, I have always been there – behind the O’Reilly table, filled with all the pale blue books. You guessed this year I am not going to YAPC as it is outside of my territory – that feels very strange and my Summer is incomplete. Come on Perl people get YAPC back in my part of the world! Since I cannot talk about YAPC, I will talk about two new (or not so new courses) that we have organized with Floss UK. These courses are not just about Perl but the tutor is the Perl Guru – Damian Conway.

I will not bore you with the details of the course, you can read them on the website -

Regular Expressions Training Course

Thursday 11th October 2012

Venue: Imperial Hotel, Russell Square, London WC1B 5BB

Presentation Skills Training Course

Friday 12th October 2012

Venue: Imperial Hotel, Russell Square, London WC1B 5BB

 

I thought I would just give you some examples of people’s feedback after they listened to Damian’s courses or talks. First quote is about the “Presentation Skills” course given in London in April (I know you’ve read this quote in a previous post but if the BBC can do repeats why can’t I):

“I attended Damian’s ‘Presentation Aikido’ yesterday. It’s the only time I’ve remained so engaged with a subject for 7-8 hours, and that includes school, university, OSCON and an all night session with Lord of the Rings. What’s even more impressive is that I remained engaged with a subject I normally find incredibly tedious. Like almost everyone else, my professional life has been blighted by three dimensional transitions, psychedelic colour schemes and psychotic presenters, not all of my own creation. Damian’s skill is to focus on the content and to cut the rubbish that can make presentations so unbearable. And that content is unparalleled. Using his hard-won experience as a speaker, he imbibes attendees with a very real sense of what it takes to make great presentations, and that’s the best possible outcome I could have hoped for.” - Graham Morrison, Linux Format

Then I ramdomly took some quotes from Damian’s website - please note for once I am not guilty for the typos etc.

“Damian is a witty, engaging and experienced speaker and it shows in his delivery style and the quality of his talk and slides. He makes the whole process of presenting look effortless. Of course, if you had attended his class on presentations you would know that he had already practiced his talk at least three times in the week before. That was an important lesson and it does help as it makes you confident and knowledgable about the flow of your talk. There were several other tricks that Damian gave in that presentation and if you get a chance to attend, I recommend you take it.”

“Dr. Damian Conway is an extremely clever, creative, witty, and entertaining lecturer. He has been aptly characterized as a cross between Donald Knuth and Monty Python.”

“Damian is the most engaging and motivated instructor I’ve had the pleasure of seeing. I can’t wait to see what he has up his sleeve in the next twenty years!”

“Very knowledgeable (for obvious reasons) as well as congenial and animated. Made the subject quite fun and very enticing.”

“Informative and interesting; not boring. Lively speaker; no way to get any sleep in here.”

“Great pace/instruction. Damian is an excellent teacher; very creative and knowledgeable. The humor really made for a great presentation.”

“Damian is a top-notch instructor. I was extremely pleased. It’s good to be taught by leaders in the field!”

“Too much fun; should be declared illegal!”

I hope I have convinced you that these two courses are a must, if not have a look at Damian’s website where you will find more fantastic quotes.

 

What is Machine Learning?

2012 July 26

When I introduce myself to people as one of the “machine learning” guys at Rangespan, most often people will follow up with “What is Machine Learning?”. It’s a good question so let me explain.

Machine Learning is about how we can make computers learn like humans do. Let’s take the example of learning language. Take a one year old toddler, she might hear this new word called “bird” when people point to an object in the sky and decide to start using it herself whenever she sees something in the sky (perhaps mistakenly when it was an airplane). What that toddler just did is remarkable; she didn’t just memorize or associate the word “bird” with the occasions in which she saw things in the sky previously, rather she discovered a pattern in how the word “bird” is used, and decided to use it in a similar but slightly different context.

This idea of using pattern recognition to make generalisations lies at the heart of machine learning. A classic example studied extensively in the academic community is hand written digit recognition. All hand written digits differ from each other in big or small ways. What we’d like to do is discover broad patterns to be able to automatically recognise hand written digits: e.g. a six looks a bit like a spiral, a four has no round bits, … We could try to have programmers encode these patterns in algorithms but a much more successful approach, pioneered by nature and rediscovered by the machine learning community, is to give a computer a few examples of hand written digits together with their labels and let it figure out what patterns are useful to distinguish different digits. “Machine learning people”‘s jobs are about inventing new algorithms that can learn patterns from existing data in order to generalize.

For this reason, machine learning is also a driving force behind the big data movement. When more data is available, most machine learning algorithms can more easily discover patterns and generalizations.

For the past few years I had done lots of machine learning research at Microsoft in Cambridge but in September last year I decided to join a startup in London. The first thing that struck me was the buzz at the various meetups that are organised in the city. It’s great to join a group of people to talk about a common topic.

When a friend in New York sent me an email late last year about a discussion they had at the New York Machine Learning Meetup I imagined how fun it would be to get some people together in London to talk machine learning. When we started contemplating the structure of the meetup we thought we could make the meetups even more interesting if we could bring people at the cutting edge of research (academics) with people at the cutting edge of practice (industry) in the same room.

So in February 2012 we kicked off the first meetup with Jedidia Francis (PhD student from Oxford) and David Singleton (Google). We organised that meet up in the dev room at Rangespan and when 25 people showed up, space got a bit tight.

Six months and eight speakers later our group has grown to more than 300 people. We’ve had speakers talk about self driving cars, agents that learn how to play civilization from reading the manual, … We’ve learned about how machine learning systems are used at big organisations like Microsoft as well as at small startups like PeerIndex. We’ve been sponsored by PeerIndex, Forward Internet Group, VisualDNA, Rangespan and O’Reilly.

It’s quite clear that machine learning is hot, smoking hot. It’s exciting to see so many people wanting to learn machine learning and apply it to their application domain. I believe that there is no other place in the world where there is so much high quality machine learning happening than in and around London: with universities like UCL, Oxford, Cambridge, …, startups like PeerIndex, Last.FM, Rangespan, …, established companies like Microsoft, Google and all the hedge funds there is an almost unlimited supply of people who know machine learning as well as an unlimited demand for people who can work in machine learning.

If you want to help out by presenting your work and/or sponsoring the meetup, do get in touch. Otherwise, I look forward to meet all of you at the London Machine Learning Meetup soon!

Jurgen is a dev manager at the e-commerce startup called Rangespan where he is helping to build the biggest catalog and most competitive marketplace in the world. Before joining Rangespan Jurgen was a research scientist at Microsoft. As part of the Bing Personalization team, Jurgen invented new statistical models for predictive tasks and helped develop Bing’s recommendation engines. Jurgen has a PhD in Machine Learning from the University of Cambridge, an MSc in Computer Science from the University of Wisconsin-Madison, an MSc in Informatics from the Catholic University of Leuven, and was a Fulbright Scholar.

Presentation Skills - the Aikido Way

2012 July 17

I don’t think I’ve ever attended a training session that began with the tutor pushing me towards a wall after reassuringly telling me that he “wasn’t going to hurt me”, but this training session is like no other that I’ve attended.

Damian Conway, minor deity of the Open Source and Perl world is not like other trainers. A professional presenter, Damian tours the world speaking at conferences and providing training far and wide from his native Australia in what can only be described as a unique and elegant style.

 

Our martial arts introduction to the day was of course all part of a carefully planned and executed methodology designed to teach us how we too could excel at presenting.

Our tutor better described this as “Presentation Aikido” or a way of harmonising with the flow of the Universe, or in our case our audience.

Sticking with the advice of keeping focus on five to seven points, we learned all about the seven key points of presentation.

  • Be competent - only talk about things you know about.
  • Be passionate - only talk about things you either love or hate.
  • Be entertaining - it’s the key to communication
  • Be prepared - most of your work is done before you step in the room.
  • Be stylish - nobody likes a bad slideshow.
  • Be engaging - connect with your audience.
  • Be yourself.

For me, the biggest eye opener was when Damian told us that he spends around one hundred hours preparing for each hour he presents. Us mere mortals should probably be trying for twenty to thirty hours though!

Don’t just take my word for it, Graham Morrison of Linux Format had this to say:

“I attended Damian’s ‘Presentation Aikido’ yesterday. It’s the only time I’ve remained so engaged with a subject for 7-8 hours, and that includes school, university, OSCON and an all night session with Lord of the Rings. What’s even more impressive is that I remained engaged with a subject I normally find incredibly tedious. Like almost everyone else, my professional life has been blighted by three dimensional transitions, psychedelic colour schemes and psychotic presenters, not all of my own creation. Damian’s skill is to focus on the content and to cut the rubbish that can make presentations so unbearable. And that content is unparalleled. Using his hard-won experience as a speaker, he imbibes attendees with a very real sense of what it takes to make great presentations, and that’s the best possible outcome I could have hoped for.”

If you don’t know how to do these things then I recommend getting yourself to the next session coming up in October!

Damian will be back in the UK and will give the following full day courses

Ian is a keen Perl hacker co-founding and co-chairing Northwest England Perl mongers for the last three years. Lately his focus has gone back to an old love in the form of network monitoring and management since working on an OpenNMS project for his employer. When not wrangling exim, herding linux system and working on access control technologies, he can be found roleplaying or singing tenor.

This is a free demo result from the Wayback Machine Downloader. It is not a complete website.