Category Archives: Mashups
@NMK Podcast: Dan Gillmor’s keynote
@NMK: Dan Gillmor: New genres of journalism online
Wired: Web Mashups Turn Citizens Into Washington’s Newest Watchdogs
Project Red Stripe: Fire away
Brighton crime story shows how far FOI still has to go
Roy Greenslade yesterday pointed out that the Argus had used the Freedom of Information Act to produce a ward-by-ward breakdown of crime figures in Brighton.
Two thoughts. First, why was it necessary?
Ward-by-ward crime figures are the sort of public data that should be routinely available to the public. There is nothing remotely sensitive about this information, which is inevitably collected by police and is in the public interest to disclose. In an ideal democracy, it wouldn’t really be necessary for a journalist to file a Freedom of Information Act request in order to obtain this data. A glace at a web site, or at most a simple call to the Police press officer, should suffice.
We often hear that the object of the FOIA is to instill a culture of openness in the public sector. Let’s hope that Sussex Police take the hint and start handing this data out regularly so that this can just become another routine story for the Argus. If they don’t, may the Argus bombard them with FOI requests every month until they do. And may other regional papers do the same for every other force in the country.
That, after all, is the beauty of FOIA. Robust use of requests by the press for non-frivolous, public-interest information helps to achieve Parliament’s intent to create a more open government. Responding to requests from journalists is not, as Lord Falconer keeps suggesting, a giant public subsidy to news organisations’ editorial budgets — it’s the Act working as his Government originally intended.
Of course, if Lord Falconer has his way, the Argus might not get to play its role in this. Regional newspapers like the Argus would be hit very hard by his proposed changes to the FOIA fees regime. The proposal to allow public bodies to treat multiple, unrelated requests from an organisation as if it were one request would mean that the Argus would quickly use up its quarterly quota of requests to the local public bodies it covers, like Brighton & Hove City Council or Sussex Police.
So much for the press doing its part to help the Government achieve its purported aim of engendering a culture of transparency in the public sector.
Second, the Argus investigation was obviously very good journalism, but it also shows how far there is still is to go until newspapers start making full use of the sort of data that could become available under FOIA.
When I read that there was a “full online breakdown” on the Argus web site, I followed the link half-expecting a slick GIS mashup of the data. After all, the much-cited example of a great journalistic mashup, ChicagoCrime.org, is based on plotting routinely-available police data onto a dynamically-generated online map.
No such luck, obviously. Maybe next time. If there is one.
Freedom of Information, mashups and online journalism
My long silence here is due to the fact that every spare minute of my day job has lately involved building a rather complicated WordPress installation. More blogging on my own time would probably drive me a bit mad.
Part of the project that I’m working will include the overdue relaunch of the blog version of my Press Gazette column, “Fleet Street 2.0“. For those of you who don’t subscribe to the print edition (shock, horror), the column has for the past two weeks looked at some of the ways that Press Gazette’s campaign against the Government’s proposed changes to the Freedom of Information Act fees regime relates to the future development of online journalism.
The greatest promise of the UK FOIA is that by engendering more openness in the public sector, it could begin to facilitate what is sometimes called “computer-assisted reporting”. Investigative journalism based on original analysis of large volumes of data are far more common in the United States and Scandinavia, where better-established FOI regimes have placed a comparatively huge volume of electronic public records into the hands of journalists who aren’t put off by spreadsheets, databases and GIS software.
For the last few decades, these techniques have been hidden away in newsrooms, where a handful of journalists used them in reporting investigative projects. To the reader, the data underlying the stories it produced generally remained hidden.
But today, presenting structured data in a way that users can search and interpret for themselves is possible online. CAR now involves new forms of presenting information as well as an established set of research techniques.
As Derek Willis, the database editor at WashingtonPost.com, has written, the web is the “natural canvas” for computer-assisted reporting. Journalists can present public data that they have obtained online, providing the tools that individual readers need to drill down to the information that is most directly relevant to them.
Few UK news organisations have really taken to heart Adrian Holovaty’s view that journalism should include the the collection and presentation of structured data. But the way Government information policy affects this nascent form of journalism can be seen by the experience of people outside traditional news organisations who have — such as those who are building mashup web sites.
OnOneMap, for example, recently added a feature that allows users to plot all 60,000 mobile phone base stations onto a Google Map.
The site’s founder, Philip Sheldrake told me that he produced the database he needed for his phone-masts mashup by “scraping” the output of Ofcom’s publicly-available Sitefinder database. Using scripts to automatically collect large datasets from public web sites and putting them into a structured form that can be analyses is also one of the skills of investigative journalists specialising in CAR techniques.
The OnOneMap mashup is a great example of something that has only becaome possible because of the Freedom of Information Act. As Steve Wood, (now formerly) of the UK Freedom of Information & Open Government Blog pointed out, the geographical coordinates that make OnOneMap’s mashup possible only became available on Sitefinder last September after the Information Commissioner ruled that Ofcom should release it following a request under the Environmental Information Regulations (a version of the Freedom of Information Act that applies to all forms of data about environmental issues).
Complex requests, like ones for large datasets that allow geo-coding mashups like this one, are much more likely to be rejected if the Government implements its proposals for the Freedom of Information fees regime. The Government’s plans would make it much easier for public officials to reach the £600 cost threshold beyond which they may turn away FoI requests.
The data used by OnOneMap has also been noted by the “Free Our Data” campaign that the Guardian’s technology section has been running for the past year. That campaign highlights another issue in information policy that is limiting the development of this form of journalism in Britain: Crown Copyright.
Unlike the United States, where public data is generally copyright-free, Crown Copyright can be used in Britain to prevent the republication of public sector information even once it has been forced into the public domain by the Freedom of Information Act or other open government laws.
For most news stories this is not a problem, because reporting the contents of file does not require its full reproduction. The use of public information for journalism is (usually) acceptable under Crown Copyright. Other users of such data, however, might require prohibitive licensing fees to reuse data produced at public expense. The question remains whether mashup sites will come to be recognised as a new form of journalism regardless of who produces them.
Again OnOneMap provides an example. Sheldrake may have to fight for the right to produce the next section of his mashup: the Environment Agency, he says, has already warned him that the flooding data is hoping to obtain from them under FOIA cannot be reused on his site without a license.
Some might argue that OnOneMap isn’t really journalism but just a business looking to use public information for commercial gain. But that would be nonsense that wrongly defines journalism with reference to the organisation that undertakes it. If Guardian Unlimited or Telegraph.co.uk produced something like this within their property market sections — or if their print editions ran the entire table in tiny print over acres of newsprint — this would be recognised instantly as the added-value journalism that it is.
- There’s still time to support Press Gazette’s campaign against the FOIA fees proposals by signing the petition that will be handed over to the Government next week.
A crash course in journalism and Web 2.0
A lot of people have been linking to the new issue of Nieman Reports, a special issue titled “Goodbye Gutenberg” and about the transformations happening in newspaper journalism and the rush to digital.
There’s a lot to get through, but a good place to start is the introduction to Journalism and Web 2.0 by Francis Pisani. It begins with a summary of the always-controversial discussion of what “2.0″ actually means, and then admonishes journalists to take note of these developments even if they can’t see the immediate relevance to their craft as it is traditionally understood:
Change starts at the edges. That’s where people—our readers and viewers—probe new practices. That’s also where their emerging culture is forming, a culture in which they look at media from a different perspective. And so journalists’ new thinking needs to begin at the periphery, where change comes quickly among the younger generation of users, and a lot more slowly for us. Tomorrow’s potential readers are using the Web in ways we can hardly imagine, and if we want to remain significant for them, we need to understand how. Yet news organizations have been all too slow to notice movement in places that are away from what has been their center.
In remarkably few words, Pisani runs through the effect on traditional media being caused by the ideas underlying Google, Craigslist, Wikipedia, Digg, Newsvine, and news mashups like ChicagoCrime.org. Blogging, citizen journalism and RSS are covered, too. It’s an invaluable crash-course introduction.
BBC News via Twitter
A second experimental Twitter mashup sends you BBC News headlines to you via SMS.
It’s already improving on last week’s CNN mashup by adding a web link to each post. Its creator, Mario Menti, explains.
Update: As Graham points out in the comments, the BBC News feed is a little overwhelming. Perhaps the next stage will be a site that lets users customise which news items they want to receive, perhaps using seperate Twitter accounts for different sections of a news site.
CNN breaking news mashup on Twitter
Josh Bancroft has noticed that there is a user on Twitter with the username CNN Breaking News.
It certainly looks like the news channel someone is experimenting with using the mobile social networking tool to break news headlines.
Twitter is certainly a clever technology combining blogging, text messaging and social networking. The site allows users to post 160-character posts that can be delivered to their network of friends and assorted online stalkers via SMS or AOL Instant Messenger.
It can be a fun way to keep in touch with many friends simultaniously. Over the holiday period, my phone was bombarded by Twitters sent by food blogger Graham Holliday detailing his gluttony over the holidays, 160 characters at a time.
So far, that’s how I have been using it — as a toy. But CNN’s this experiment suggests that it has potential as a platform for more serious applications for journalists like delivering news and obtaining instant feedback from readers’ mobile phones.
I may eventually work out how to use Twitter to deliver short news items. For now, you can subscribe to my feed of odd random text messages from me by adding me as a friend on Twitter.
Update: In the comments, Bobbie Johnson points out that we may be dealing with a mashup of sorts. Credit is apparently owed to James Cox, and not anybody in Atlanta. It’s a great idea whoever is doing it — I hope more useful applications like this will be created for Twitter.
Update2: Cox explains his mashup elsewhere.
Mapping a pandemic
Nature has a feature that uses Google Earth to chart the avian influenza epidemmic. WorldChanging puts it in context.