AfTerFibre UpdateOctober 2011

This is a short summary of progress and learning from the first couple of months since launching AfTerFibre, a project to map terrestrial fibre projects in Africa. From the beginning AfTerFibre has been designed as an open project both from the point of view of transparency and from the point of view of participation. So the first goal was to make it easy to share information. This involved setting up a AfTerFibre Google Group so that anyone could contribute information or ask questions.  Next we needed a place to store resources as we found them so a wikipedia page was set up to capture information and links to maps of terrestrial fibre projects.  That part has gone reasonably well.  We now have 83 people in the Google Group and the Wikipedia page now has 67 African  operators known to have fibre projects listed, for which about half have links to maps.  Where possible I have linked directly to the map on the web if it exists.  In other cases, I have uploaded map images that I have found to a Flickr set.  Finally there is also a Diigo list of news links related to AfTerFibre.

Having gotten the repositories for the raw information in place, the next challenge was to find out how to create an information chain that would make it easy not only for people to contribute map information but also to submit updates. I’ve been working with some of Google Africa’s GIS team in Nairobi to solve this.

Step 1 – Convert Image Maps into GIS Maps

This stage of the mapping turns out to be remarkably simple. GoogleEarth (GE) is an amazingly simple yet powerful tool. You can import any jpg or png image of a map as an overlay into GE. GE makes it a piece of cake to stretch the image to neatly match the image map borders with the real GIS borders in GE. This makes it relatively simple to then trace fibre routes with the Path tool. I really can’t overemphasise what an amazing job the Google Earth designers have done to make it easy to trace maps. As an example, when you are actively tracing a path in GE, the mouse is no longer available to move the geography as you trace along a line. Happily the keyboard arrow keys are enabled for this purpose allowing you to trace with the right hand and move the geography with your left hand. More software should be this well designed. Because I am a GIS greenhorn, I have just assumed that KML is the appropriate format for this data.

Step 2 – Create a online updateable repository of map data that can feed the AfTerFibre Map

Our initial assumption was that Google Fusion Tables would make a good data repository. It is capable of directly importing the KML files generated from the tracing of maps in Google Earth. The map you see above is a direct representation of the AfTerFibre maps after a simple import into Fusion Tables.

Here is where things get more complicated. Fusion Tables turns out to have some idiosyncrasies (it’s still in Beta) which make it somewhat problematic for AfTerFibre. For a start, it doesn’t allow for easy multi-row editing so if you wanted to make a change across an entire country or operator, it is a very slow process. Second, while Fusion Tables allows you add fields, which is essential for AfTerFibre to capture all the additional information on fibre projects, Fusion tables stops importing KML files properly after you change the database structure. The geo-coordinates are mapping into text fields etc. Chaos and confusion.

An alternative then is to import the KML files into Fusion Tables and directly export as comma separated files (CSV) files which can then be imported into a spreadsheet program. A spreadsheet solves some of the problem by allowing multi-record editing and also making the data easier to massage in general. Each time a new fibre map is made, it could be imported into Fusion Tables, saved as CSV, imported into a separate spreadsheet and edited to match the field layout of the master spreadsheet and the imported into the master spreadsheet. The master spreadsheet can then be exported to CSV which can then be re-imported into Fusion Tables for display in Google Maps.

If this were a one-time process, the above might be an acceptable solution but not only will new maps regularly be added but existed maps are likely to receive numerous corrections.

So, what to do? It seems to me that what is needed is some kind of versioning repository (like Github) for the KML files for AfTerFibre. I’ve done some googling around this but haven’t come across anyone who is storing their KML in a versioning repository. It seems like a clever idea but it worries me that I can’t find anyone else doing it.

If KML files could simply be updated in a Github or similar repository, then it wouldn’t be that hard to write a script that retrieved the files from the repository and massged into a GIS display with the appropriate mouseover information displays etc.

So, I’m a little bit stuck here and open to suggestions.

Randomness vs LeadershipThe inevitable meets the ineffable

Adapt Why Success Always Starts With FailureA book that has been on my mind a lot recently is Tim Harford’s Adapt: Why Success Always Starts With Failure. Tim Harford is a great story-teller and he makes his case Gladwell-style by mixing research with individual narratives that bring research results to life. He convincingly articulates the point that life is a lot more random than we imagine and that we are much less capable of predicting the future than we imagine.  This is not exactly a new concept.  Nicholas Nassim Taleb made the case that markets are much less predictable than we think in 2001 with Fooled by Randomness.  He went further than that in 2007 with The Black Swan: The Impact of the Highly Improbable in which he argued that not only are complex systems unpredictable but they are prone to catastrophic failure.

It is this message that Tim Harford drives home in his book.  He states that economies, governments, corporations, and markets are not the essentially predictable entities, naturally tending towards equilibrium, that neo-classical economics tells us they are.   Instead he builds on the work of people like evolutionary economist Eric Beinhocker and complexity theorist Stuart Kauffman (among others) arguing that an evolutionary model offers a better explanation for market behaviour, the life and death of corporations, and human systems in general.  If systems are effectively unpredictable, Harford draws the inevitable conclusion that making big bets on the future may not be such a good idea.  He draws on what we’ve learnt about evolution and suggests we follow some basic rules of success for evolutionary environments.  He boils this down to three rules of thumb:

  1. Variation —  keep trying new things, keep throwing stuff at the wall and look for things that stick.  He backs this up with some fascinating research from Cesar Hidalgo on how economic growth is correlated with diversity.
  2. Survivability — thinking of trying something new?  Do it on a scale where failure does not cause catastrophic damage.  He doesn’t lack for recent examples where big systems have failed to massive human cost whether the global banking system or the Fukushima nuclear reactor disaster
  3. Selection — keep reviewing your choices, weed out the dead-ends and reinforce success.  This is good advice but here Harford is a little less convincing as to how to go about this.  And indeed it turns out that we are naturally bad at acknowledging our own failures.  He has some great evidence about how bad we are but not much advice on how to compensate for it except perhaps through self-awareness of this inbuilt human failing.

This is a pretty compelling argument, especially in the light of the obvious lack of predictability and catastrophic failures that we have seen in the last few years.  He should have stopped there.  But unfortunately he goes on to link this issue to leadership.  He cites the work of economist Paul Ormerod who has compared the extinction patterns of animal species over a half billion years with the life and death of corporations and found some striking similarities.  This is good as far as it goes and reinforces the notion of markets as evolutionary systems.  He goes further though drawing on some additional work of Ormerod in which he attempts to create a mathematical model which represented corporations as modestly successful planners.  Ormerod found that this model couldn’t be made to match the extinction pattern of corporations nearly as well as the straight-out evolutionary model.  Tim Harford takes this result and says:

We should not leap to conclusions based on an abstract mathematical model, but Ormerod’s discovery strongly implies that effective planning is rare in the modern economy.  I wouldn’t go so far as to suggest that Apple should replace Steve Jobs with a dart-throwing chimpanzee — even though it would certainly liven up Apple product launches.

Harford fails to take his own advice here because he does leap to the conclusion that leadership is overrated.  Don’t get me wrong I am not in favour of the cult of the CEO nor do I think that the vast majority of them deserve the salaries that are orders of magnitude larger than their co-workers.  However, I do think he confuses planning with leadership, implying that the fact that leaders cannot predict accurately predict the future reduces their utility.

Steve Jobs is a great illustration of this and, as luck would have it, his recent decision to step down will be a good opportunity to test Harford’s theory.  The popular perception of Steve Jobs is of a visionary CEO leading his loyal acolytes into the future.  That represents a basic misunderstanding leadership.  This Harvard Business Review entitled Why Apple Doesn’t Need Steve Jobs articulates it well.  What Steve Jobs gave Apple was not so much great future foresight but great culture.  Steve Jobs inspired Apple staff with a vision, a sense of mission, an esprit de corps.  So powerful was this cultural leadership that people buy Apple products in part to access that ineffable quality that seems to permeate Apple products.  Having said that, it is not entirely clear that Apple doesn’t need Steve Jobs as research by Clayten Christensen referenced in this Economist article indicates that:

during Mr Jobs’s first tenure at Apple, the company’s innovation premium was 37%. In 1985-98, when Mr Jobs was elsewhere, the premium fell to minus 30%. Now that Mr Jobs is back, the premium has risen to 52%.

To be fair, the innovation premium and how it is calculated is yet another subject of debate.  But what is true is that most of us have, at one time or another, experienced leadership and know what kind of impact it can have on us personally.  A great leader (not always the top dog) makes us want to be better than we are and makes us feel that we are part of something larger.  Great leaders inspire us to transcend our own limitations.  They inspire a sense of purpose.  This quality, while very tangible is also hard to measure which is perhaps why it doesn’t feature in Adapt which, in its quest to build conclusions on hard evidence, misses the bigger picture.

Tim Harford also wonders at how we rate politicians.  He asks, if trial and error is indeed a more sensible approach to decision-making around complex systems, why do we applaud politicians like Margaret Thatcher who famously said “You turn if you want to. The lady is not for turning” or Tony Blair who claimed not to have a reverse gear.  Worse than that, politicians who change their mind are branded as flip-floppers.  Why don’t we embrace leaders who are publicly prepared to change their minds.  Again, he betrays a misunderstanding of leadership.  A big part of leadership is to inspire the people you are meant to be leading, even occasionally at the expense of the truth.

My favourite example of this is from the movie Band of Brothers TV mini-series that profiles the lives of men in a company from the U.S. 101st Airborne Division in World War II.   The scene I am referring to is from the 7th episode, The Breaking Point, which finds the company in winter with little food and under heavy bombardment.  Their nominal leader, a Lieutenant, is unfit for the job and largely absents himself from the front lines.  The company sergeant is left to “lead” the company and what got me thinking was how he responded to the men who began to voice their doubts and suspicions about their lieutenant.  He lied.  He told them what they needed to hear, which was that everything was alright and that they were going to survive.  People talk about the “air” of success and the “smell” of defeat.  Our attitudes shape the future as surely as our resources and abilities do.  Politicians talk that way because we want them to.  We want to believe that we’re heading in the right direction and that everything is going to be alright.  The ironic thing is that believing plays an important role in it turning out to be true.

This doesn’t in any way invalidate the importance of an evolutionary trial & error approach.  It means we need leaders who will give us the confidence to fail and move on with the certainly of succeeding eventually.

 

 

 

AfTerFibreMapping Terrestrial Fibre Optic Cable Projects in Africa

When I started putting together the African Undersea Cable Map about 3 years ago, I did it to solve my own problem.  I couldn’t make sense of all the news articles about new undersea cable projects and where and when they were and weren’t landing.  At the time, all of the cable operators were only interested in publishing maps of their own cable. It seemed an easy task at the time to put the 2 or 3 planned cables on a single map.  Little did I imagine that they would mushroom to the variety of African undersea cable projects we see today.  As more undersea cable projects were announced the cable map became an increasingly useful reference.  As it turned out, I wasn’t the only one trying to keep the various undersea projects straight and the map has become far more popular than I would have ever guessed.

But I don’t think it is just the usefulness of the map that has driven its popularity, nor my infographic design skills which are admittedly basic.  My theory, for which I have no other evidence than the nature of the feedback I have received from users, is that the map paints a different-from-the-usual picture of Africa. It’s not a picture of a dark continent but rather a brightly lit one, lit by terabits of light capacity brought by a dozen cables landing on sub-Saharan African shores either now or in the near future.  Africa, the brilliant continent.  This also happens to be the Africa I believe in.

Another thing I think the map has contributed to in a small way is the sense of latent capacity that has inspired investment in national terrestrial infrastructure in Africa.  To my knowledge, every country on the continent has some sort of terrestrial fibre infrastructure project either completed or underway to connect to an undersea cable or to a country with an undersea cable.  This unprecedented explosion digital infrastructure investment can only be attributed to the sense of the opportunity that the burgeoning African undersea cables represent.

But now I find myself with the same problem again, but inland.  I keep reading announcements of terrestrial fibre projects in Africa but I can’t keep them straight in my head and few of them seem to publish maps.  I feel compelled to once again start pulling this information together into something comprehensible.  But mapping terrestrial fibre is a much bigger challenge, lots more cables, and more accurate mapping too.  I was a little daunted in taking something of this scope on.

That was until Google Africa stepped into the picture.  They have kindly offered to help build this map as one of their policy initiatives and to provide some support from their GIS gurus in Nairobi.  When complete the map will be hosted by the UbuntuNet Alliance who are working hard to build a high-speed university network linking all African countries.  They understand both the importance and the challenge of building cross-border fibre infrastructure.

My hope is that when this project is complete that a mayor of a secondary or tertiary city in Africa will be able to look at this map and say, “Hey, we’re only 90 kilometres from the XYZ fibre cable.  Let’s talk to XYZ and see how we can set about making our city a regional digital hub.  We’ll kickstart local enterprise and make the Internet an integral part of schools in our city.”  Or something like that.  I hope that a map like this will inspire the same sort of local/regional projects in the way that undersea cables have inspired national fibre projects.

Because African Terrestrial Fibre Optic Cable Map is a bit of a mouthful, I’ve shortened it to AfTerFibre.  If you’re interested in terrestrial fibre mapping or are an operator of terrestrial fibre in Africa, please come and join us in the Google Group.  Together we’ll show the rest of the world how brightly lit Africa already is.