Hackers wanted! Scholarships available to coders who'll come to journalism and help save democracy

Guest blogger Brian Boyer is a hacker journalist who writes about the intersection of technology and journalism. He's worked at public-interest journalism site ProPublica and is now at the Chicago Tribune, building their new News Applications team.

It's not news that journalism is in crisis. CNN turned newspapers into first-day fishwrap and Craigslist killed the business model. Solutions are scarce, and our democracy is at risk. I don't have a chart to guide our way through the darkness to Citizenry 2.0, but there are some who can navigate the singularity.

Journalism needs great hackers. Not just nerds, but programmers who care -- about the values of journalism and the power of a free press to hold government accountable. Luckily, hackers are a freedom-minded bunch. The free software movement is rooted in many of the same principals that guide journalism. But news organizations aren't very sexy places to work -- especially now, as layoffs, bankruptcy and closures plague the industry. So how can we bring nerds to the news? One old-skool school is trying.

Free beer school!

Tell your programmer friends: The Medill School of Journalism at Northwestern University is giving away full scholarships, plus expenses, to software developers.They can get a masters degree in journalism, gratis, from one of the most prestigious J-schools around.

I recently graduated from the year-long program, during which I studied with with one other hacker and ~45 brilliant 'normal' journalism students. I interviewed lawmakers, farmers and shopkeepers and wrote stories about agriculture, waterways, and the diabetes epidemic in Illinois. It was difficult to shake my introverted, google-first, face-to-face-as-a-last-resort programmer nature. But it was also thrilling.

Journalism is an info-geek's dream. You're constantly learning new topics, speaking with experts, and distilling real-world issues to their essence -- all in the mission of informing the folks who don't have time to soak up all that data. It's like being paid to write a new Wikipedia article every day.

We also wrote some software. My programmer colleague and I banged out enviroVOTE in a frenetic weekend of coding and coffee in the days preceding the election. The night of, we were tied to our keyboards, tallying results and tweeting updates while the rest of the world was watching TV. Such is the life of a journalist.

For our final project at Medill, the two coders and four non-coder new-media students built NewsMixer, an experiment in integrating social networks with news coverage. It was one of the first applications to roll out on Facebook Connect, and remains one of the only apps that explores its full potential. All the code is GPL'ed and has already spawned other open-source projects.

This is the time to remake journalism

Programmers have been making an impact in the news world for some time, but until recently most innovation in this space has been in creating new ways to present the old style. With a few shining exceptions like the datavisuals by the New York Times, most online news could have been written on a typewriter and mailed to Google for indexing.

Then, something amazing happened: Software won a Pulitzer Prize. Created by hacker journalist Matt Waite and other fantastically clever folks at the St. Petersburgh Times, PolitiFact is form of news that could only exist online. Aron Pilhofer, leader of the innovations team at the NYT, put it perfectly:

But is it journalism, some people asked? There's no lead per se, no narrative and no pyramids anywhere to be found, much less the inverted sort.

Journalism is about helping people make sense of important issues, and how those issues affect them personally. It's about uncovering that which someone wants to keep hidden. It's about holding people we place in high public office accountable. And by those definitions... PolitiFact more than meets the test. It takes a traditional form of newspaper reporting -- fact-checking what politicians say -- and scales it up in a way only possible on the web.

The NYT's Represent and its open-source cousin, Repsheet, are innovations much in the same vein, and their existence is a sign of the times. The tools now available to hackers are so great that we can think far beyond content management systems. The moment has come when a couple of great hackers can knock out a fully-fledged new form of media in a matter of weeks. Tell the Twitterati: there are lights in the distance.

Hackers wanted

The news is waiting to be saved. We have the technology, all we need is more nerds. So ditch your boring corporate gigs and come to journalism! Democracy is one hell of a fun problem to hack.

Four short links: 1 May 2009

Smart Grids, Open Source, Stuff That Matters, and Global Culture

1. A Little Give and Take On Electricity (NY Times) -- Dennis L. Arfmann, a lawyer at the Boulder office of Hogan & Hartson who specializes in environmental law, said he had no idea how much electricity he and his wife, Dr. Julie Brown, had used before he filled his roof with solar panels producing 4.5 kilowatts of power. During the day he sells power to Xcel and at night he buys it back; his goal is to cut his use so his net sales rise. All hardware networked, everywhere!
2. Open Source World Map (Red Hat) -- very nice map showing the intensity of open source use in countries around the world. (via Flowing Data)
3. Imagine Cup -- Microsoft's contest to get students working on stuff that matters. The winners of the New Zealand leg, Team Think, tackled literacy: they devised a program for tablets that provides both handwriting recognition and audio output, eliminating the need for basic literacy to understand lessons or instructions. They hope to take this prototype to developing countries that have underutilised computers due to literacy issues. (via Idealog newsletter and Scoop)
4. UGT -- It is always morning when person comes into a channel, and it is always late night when person leaves. [...] The idea behind establishing this convention was to eliminate noise generated almost every time someone comes in and greets using some form of day-time based greeting, and then channel members on the other side of the globe start pointing out that it's different time of the day for them. Now, instead of spending time figuring out what time of day is it for every member of the channel, we spend time explaining newcomers benefits of UGT. (via migurski on delicious).

Four short links: 22 Apr 2009

Government, Bayes, SMS, and distributed keystores:

1. Government Projects the Agile Way -- Can It Be Done? (NZ Government) -- notes and audio from a workshop at the New Zealand State Services Commission looking to merge agile and government. The pullquotes are mostly generic about agile, but the important thing is that there are agile projects within government and their numbers are growing. Having witnessed the incredibly slow, cautious, and non-agile development processes of government, I know how good this shift can be for budgets and delivery.
2. DivMod Reverend -- general purpose open source Bayesian classifier in Python (the Ruby port is Bishop). Bayes theorem lies behind the 2000-era spam filters, and there have been plenty of open source libraries to do Bayesian classification, but this one caught my eye because it's from the very good DivMod folks who are behind the very good Twisted framework. (via noahgift's delicious stream)
3. RapidSMS -- a free and open source messaging framework for building SMS applications. Integrates with Django. (via straup's delicious stream)
4. Some Notes on Distributed Key Stores (Leonard Lin) -- he had to install and test distributed keystores for a client's project, and posted his notes. Distributed keystores are one of the recent spates of database-like tools intended to solve some of the problems of big data applications. The distributed stores out there is currently pretty half-baked at best right now. [...] Don’t believe the hype. There’s a lot of talk, but I didn’t find any public project that came close to the (implied?) promise of tossing nodes in and having it figure things out. [...] Based on the maturity of projects out there, you could write your own in less than a day. It’ll perform as well and at least when it breaks, you’ll be more fond of it. Alternatively, you could go on the conference circuit and talk about how awesome your half-baked distributed keystore is. (via straup's delicious stream)

Four short links: 21 Apr 2009

Space arrays, mobile hell, book scanners, and open source brains:

1. Great Brazilian Sat-Hack Crackdown (Wired) -- Satellite hackers in Brazil are bouncing ham signals off a disused US military satellite array. Truck drivers love the birds because they provide better range and sound than ham radios. Rogue loggers in the Amazon use the satellites to transmit coded warnings when authorities threaten to close in. Drug dealers and organized criminal factions use them to coordinate operations. [...] "Nearly illiterate men rigged a radio in less than one minute, rolling wire on a coil." As William Gibson said, "the street finds its own uses for things." One man's space junk is another man's Make project. (via BoingBoing)
2. My Students, My Cellphone, My Ordeal -- there's probably a market selling lightweight forensic tools to schools, specifically to avoid scenarios like this poor man's.
3. DIY High Speed Book Scanner From Trash and Cheap Cameras (Instructables) -- $300 of parts gets you a reasonably high-quality scanner. It doesn't have an automatic page turner, but it's still a step up on "open the scanner lid, change the page, close the lid, hit scan, wait, [repeat until braindead]". We have a huge legacy of analog, and we're going to need consumer-grade consumer-priced systems if we are to rip-mix-burn our cultural legacy. What would the Google Books settlement look like if we all had high-speed scanners to do to our bookshelves what iTunes did to our CD shelves? (via BoingBoing)
4. OpenCog Brainwave Projects in Google's Summer of Code -- in case you think GSoC is all about GNOME apps getting alternate shortcuts for DVORAK keyboards, there's some esoteric stuff being approved. I wish that when I was a college student someone had paid me to work on a Application of Pleasure Algorithm Project.

Importance of Innovation in Finance & BarCampBank

“Progress is not the mere correction of evils. Progress is the constant replacing of the best there is with something still better.” -Edward Filene

Two years ago, when we were organizing the first BarCampBank in the US, many people found it hard to believe that banks & credit unions could a place for meaningful grassroots innovation. Even crazier was the idea of organizing an unconference to begin bringing open source, transparency, identity, and community into the very closed world of banking & finance.

Since then the BarCampBank idea has turned into a movement. There have been over 14 events all over the world, and many of the ideas generated are beginning to turn into action.

To me, the global financial system is a platform that exists to “create more value than it captures”. Tim explained this in his Work on Stuff that Matters post, saying:

“A bank that loans money to a small business sees that business grow, perhaps borrow more money, hire employees who make deposits and take out loans, and so on. The power of this cycle to lift people out of poverty has been demonstrated by microfinance institutions like the Grameen Bank. Grameen is clearly focused on creating more value than they capture; not so the like of Fannie Mae and Freddy Mac, or WaMu, or many of the other failed financial institutions involved in the current financial meltdown.”

There has never been a more important time to bring meaningful innovation into the financial system, and there has never been more opportunity for our community to make it happen.

The next event is occurring this weekend (April 25-26, 2009) on Treasure Island in San Francisco.

After that, the following events are planned:

• BarCampBankVegas is set for May 2, 2009.
• BarCampBankCharleston2 is set for June 13, 2009
• BarCampBankGermany is set for October 23-25, 2009

Four short links: 16 Apr 2009

China, databases, storage, and git:

1. China's Complicated Internet Culture (Ethan Zuckerman) -- summary of Rebecca McKinnon's talk at the Berkman Internet Center. Democracy is complex and hard to transition to, online democracy doubly so. Rebecca questions the widespread but unjustified belief that the Great Firewall of China is all that separates Chinese citizens from the empowered liberty of the West, and lays out the tangled state of affairs in China's political Internet. Despite the rise of web video, “no one has managed to organized an opposition party on the web,” Rebecca points out. “There’s no Lech Walenza, no religious movement - Falun Gong has been squished pretty thoroughly.” (via cshirky's delicious stream)
2. Drop ACID and Think About Data -- Bob Ippolito's talk from PyCon about the things you can do easily when you foresake the promises of ACID. More in the ongoing reinvention of databases for the needs of modern web systems. (via cesther's Twitter stream)
3. The Pogoplug -- The Pogoplug connects your external hard drive to the Internet so you can easily share and access your files from anywhere. We're accumulating terabytes of storage at home, where it's very useful to all the computers in the home. This offers an easy way for non-technical civilians to make these drives useful outside the home as well. There are many possibilities for Interesting Things in the massive storage we're accumulating. (via joshua's delicious stream)
4. Gitorious -- open source (AGPLv3) clone of github. (via edd's delicious stream)

PhoneGap, the Mobile Platform Democratizer

Phonegap is an opensource development framework for mobile platforms. It allows developers to build native apps in HTML and JavaScript. Currently PhoneGap works for the iPhone and Android, but Blackberry and other OSs are on the way. You can get PhoneGap from Github or Google Code.

There are eighteen iPhone apps listed on the PhoneGap site. Though the apps are created with web technologies PhoneGap provides access to the phone's client APIs and run in Objective-C. I tested both Roadtrippr and the fun Blok-Buster Lite. As promised the apps are able to use my phone's location, accelerometer and multi-touch controls. Though the functionality was there both apps seemed a bit flat. This could have been related to their design, but I suspect that it is a PhoneGap issue.

Nitobi, the Vancouver-based company behind Phonegap, intends to make money via future services. Developers will be able to upload their HTML and JavaScript and get back a URL for a tested, compiled app for each platform. Nitobi won the People's Choice award last week at the Web 2.0 Expo SF during our Launchpad event where they launched a desktop emulator for their supported patforms. Both Techcrunch and ReadWriteWeb covered the event.

PhoneGap still has a ways to go before it is the one framework to rule them all. Their Roadmap is below and they would be thrilled if any of you wanted to assist them. In the feature-platform matrix below green means done, yellow means in-progress and red means not currently possible (they'll have to update the redblock in the Copy/Paste column of the iPhone for when 3.0 comes out).

Though the Palm Pre isn't listed it is definitely on Nitobi's mind, but don't expect them to support regular mobiles or even earlier smart phones. Only the latest generation of smartphones will be targeted.

There's a gold-rush happening right now in mobile marketplaces. However not everyone is able to participate and not all platforms are receiving equal attention. PhoneGap has the potential to be a great democratizer. It lowers the bar for developers to create powerful applications out of very familiar web technologies. It also enables sites to support versions of their apps for mobile platforms other than the iPhone. If you don't have an iPhone (or even if you do) you should be cheering this project along.

Four short links: 2 Apr 2009

Predictions, PDF, source code control, and recommendation engines:

1. Wrong Tomorrow -- track pundits predictions and see how accurate they really are. From the ever-awesome Maciej Ceglowski.
2. PDFMiner -- Unlike other PDF-related tools, it allows to obtain the exact location of texts in a page, as well as other layout information such as font size or font name, which could be useful for analyzing the document. It also infers text running within a page by using clustering technique. Entirely written in Python.
3. Migrating from svn to a Distributed VCS -- to decide which distributed VCS to use, Brett Cannon gathered Python use cases and then showed how they'd be done with different dvcses. The result is a very useful comparison document for svn, bzr, git, and hg.
4. Online Monoculture and the End of the Niche -- interesting post summarising and explaining research into recommendation engines, drawing the conclusion that although Internet World recommendation engines show everybody lots of new stuff, we're all seeing the same new stuff and the end result is less the "riches of niches" Long Tail fantasy and more a monoculture.

Four short links: 13 Mar 2009

Museums, Labs, Businesses, and Hash--all in today's four short links:

1. Shelley Bernstein Talks About the Brooklyn Museum at the National Library of New Zealand (Paul Reynolds) -- I've written about Shelley's work before. Brooklyn [Museum] is not about using social media as just another marketing and visitor experience tool-set. Rather, as Bernstein said last night, Brooklyn Museum itself is now a social network - that is its job - to be a center for the community to have a conversation. Wonderful to see New Zealand continuing to learn from the best.
2. Google Labs India -- interesting projects, including Digital Noticeboard and SMS Channels (Google ID required to view the latter). Interesting to see the projects worked on in different countries. The latter is like Mozes.
3. Privacy and Free Speech, It's Good for Business (PDF!) -- Northern California ACLU have produced a book aimed at businesses that frames free speech issues as a business good: The practical tips and real-life business case studies in this Guide will help you to avoid having millions read about your privacy and free speech mistakes later. The advice is straightforward and specific, not of the vague and "don't be evil" variety. Give users an opportunity to defend their anonymity. Provide notice, within no more than seven days of receipt of a subpoena, to each user whose personal information is sought, and inform the user of her right to file a motion to quash (fight) the subpoena. Give the user at least thirty days from the time notice is received to file a motion to quash the subpoena. (via BoingBoing)
4. pHash, The Open Source Perceptual Hash Library -- a perceptual hash is a signature for a file, built in a way that two files that represent similar things (e.g., two photographs of the same poster). (via Joshua's delicious stream)

Four short links: 9 Mar 2009

Hardware, open source, and AI today:

1. Geek Tour China 2009 -- how did I miss this? Bunnie Huang has led a tour of China manufacturing for hardware hacking geeks. Read the blog posts from participants: here, here, here, here, and here. Just go ahead and add these bloggers to your feed reader: sweet sweet candy they post. My favourite: American Shanzai, asking where are the USA hackers like the Chinese who make working phones out of packets of cigarettes? But read the posts for giant single-digit LED clocks, markets of components from torn-down phones, and 280km of velcro/day machines.
2. Open Source Hardware Central Bank -- an interesting idea to fund the manufacture of larger runs than would be possible with self-funding, so as to achieve modest economies of scale. "Looking at Open Source Software, it's a thriving ecosystems of communities, projects, and contributors. There are a few companies, but they mostly offer "paid-for" services like consulting, tech support, or custom code/build-to-order functionality. I'd like the same for Open Source Hardware. I'd like the money problem to go away for small contributors like me and others. And I'd like to help guys like Chris and Mike and Mark and David and Jake build more cool stuff because it's fun."
3. Wolfram Alpha -- everyone is skeptical because it smells like AI windmill tilting mixed with "my pet algorithms are the keys to the secrets of the universe!", but it'll be interesting to see what it looks like when it launches in May. "But what about all the actual knowledge that we as humans have accumulated? [...] armed with Mathematica and NKS I realized there’s another way: explicitly implement methods and models, as algorithms, and explicitly curate all data so that it is immediately computable. [...] I wasn’t at all sure it was going to work. But I’m happy to say that with a mixture of many clever algorithms and heuristics, lots of linguistic discovery and linguistic curation, and what probably amount to some serious theoretical breakthroughs, we’re actually managing to make it work. Pulling all of this together to create a true computational knowledge engine is a very difficult task."
4. Open Source, Open Standards, and Reuse: Government Action Plan -- "So we consider that the time is now right to build on our record of fairness and achievement and to take further positive action to ensure that Open Source products are fully and fairly considered throughout government IT; to ensure that we specify our requirements and publish our data in terms of Open Standards; and that we seek the same degree of flexibility in our commercial relationships with proprietary software suppliers as are inherent in the open source world." Great news from the UK!

Vivek Kundra: Federal CIO in His Own Words

The following article contains several audio excerpts and transcripts from Vivek Kundra's first conference call as the newly appointed Federal CIO. After weeks of speculation it was formally announced today that President Obama has appointed Kundra, who had previously been serving as the CTO for Washington D.C.. In his previous position, Kundra pushed the boundaries of Information Technology and set the standard for transparency and accountability adopting Google Apps as a collaboration platform, video taping vendor interactions, and instituting a rigorous regime of metrics and accountability for government contracts.

In the following audio excerpts you'll hear about Kundra's plans to help push Federal IT towards more transparency and accountability. You'll also get a sense that Kundra, through his interaction with the CIO council is going to start unifying the federal government's approach to procurement and planning. In one of Kundra's answers, he suggests that President Obama will be announcing another appointment for a CTO position. This conference call was recorded on Thursday morning, shortly after the Whitehouse published a press release naming Kundra as the newly appointed Federal Chief Information Officer (CIO).

(continue reading)

Four short links: 3 Mar 2009

The problems of Creative Commons around the world, ebook futures, open source biomed research, and a new open source conference:

1. The Case For and Against Creative Commons -- skip straight to page two, where the article talks about the places around the world where CC isn't working. "More exactly, they fear that if you try to convert artists to CC who had never thought of copyrighting their works before, they may simply fall in love with the concept of making money through full copyright and stick to it." (via Paul Reynolds on a mailing list)
2. Are We Having The Wrong Conversation About eBook Pricing? -- "The first TV shows were basically radio programs on the television — until someone realized that TV was a whole new medium. Ebooks should not just be print books delivered electronically. We need to take advantage of the medium and create something dynamic to enhance the experience. I want links and behind the scenes extras and narration and videos and conversation...". Yes, but radio shows still persist even though they're delivered through the Internet. Old formats don't have to die in the face of new media, the question is what's best for a particular purpose. I read books on my iPhone as I go to sleep at night ... I don't want hypermedia linked videos and a backchannel. I don't want the future of ebooks to be 1990s Shockwave CD-ROM "interactives". (via Andrew Savikas' delicious feed)
3. Sage -- "a new, not-for-profit medical research organization established in 2009 to revolutionize how researchers approach the complexity of human biological information and the treatment of disease. Sage’s objectives are: to build and support an open access platform and databases for building innovative new dynamic disease models; to interconnect scientists as contributors to evolving, integrated networks of biological data." Apparently they'll be seeded with a pile of high-resolution very expensive data from Merck. (via BoingBoing)
4. Open Source Bridge -- open source conference in Portland, OR, started to fill the void when OSCON moved to San Jose. Very open source: they show you all the proposals, and you can even subscribe to a feed of the proposals as they come in. Many look good, though I'm pretty sure that 1993 called and wants its Tcl back. This conference might be just the excuse I need to visit Portland.

Recent Posts

• Karmic Koalas Love Eucalyptus | by Simon Wardley on February 26, 2009
• O'Reilly Labs: RDF For All of Our Books, Plus Bookworm Ebook Reader | by Andrew Savikas on February 10, 2009
• Open Source NG Databases (mailing list summary) | by Nat Torkington on February 2, 2009
• Four short links: 30 Jan 2009 | by Nat Torkington on January 30, 2009
• Four short links: 29 Jan 2009 | by Nat Torkington on January 29, 2009
• Github: Making Code More Social | by Brady Forrest on January 29, 2009
• Four short links: 26 Jan 2009 | by Nat Torkington on January 26, 2009
• Richard Jefferson Interviewed in Com Ciência | by Nat Torkington on December 23, 2008
• Open Source Mobile Roundup | by Nat Torkington on December 3, 2008
• DIY Appliances on the Web? | by Jim Stogdill on November 18, 2008
• Linux Kernel Worth $1.4 Billion | by Allison Randal on October 22, 2008
• Wikitecture - Radical Collaboration in Architecture | by Joshua-Michéle Ross on October 16, 2008