Freebase Hack Day – Open Government session by Greg Elin

November 11, 2008

Greg Elin, representing the Sunlight Foundation gave a talk at the recent Freebase Hack Day on “Government data sources, transparency opportunities, data catalogs and the Sunlight Foundation”.

Personally I think that Freebase would be an great platform for working on open government projects. Greg seemed very positive about Freebase too. Sunlight’s database IDs for US politicians are currently being loaded into Freebase as I type, so hopefully we’ll be able to make some nice political demos soon.

Greg’s talk was a very informative summary of who’s who in open data in the US, here are my raw notes:

The Sunlight Foundation give away ~$3m a year to fund tech projects in open government. They have a good summary of the government data out there.

eGovernment is generally supported in US, improvements rolling along, 1st generation IT initiatives, transparency is a given now, (especially thanks to the financial crisis) – but government big and slow and needs to be encouraged in the right direction, hence the Open Government Data Principles

Every big org’s website should have a “data catalog” page which is like an “about” page.
theinfo.org by Aaron Swartz – for people with large datasets (lots of government stuff) political parsers – critical mass of group of people parsing political data, NY times, FEC,  – code & techniques for parsing

watchdog.net data about representatives, cool visualizations + data feeds, big data dumps

public.resource.org – lots of bulk data

govtrack.us – xml dumps, scraps GEO, THOMAS –> XML

programmable web.com/government – tracking new government apis and mashups

everyblock.com – super local what’s new feeds

mysociety.org – high impact UK org, tracks foi requests, fixmystreet.com – tracks repsones very well

3 Comments | Uncategorized | Tagged: , , , | Permalink
Posted by Will Moffat

Freebase search command for Ubiquity

August 27, 2008

I just wrote a Freebase search command for Ubiquity:

If you don’t know what Ubiquity is then watch the video.

Ubiquity is going to be awesome for Firefox power-users. One of the best things about Firefox is the extension eco-system and Ubiquity is going to make writing extensions much easier.

P.S. Ubiquity is only on v0.1 and executes 3rd-party code on your machine. You probably shouldn’t install it in your main Firefox profile just yet.

6 Comments | Uncategorized | Tagged: , , | Permalink
Posted by Will Moffat

Freebase London meeting

August 18, 2008

I’ll be at the Freebase London meetup on Wednesday night. If you’re interested in mashing-up open data, server-side javascript or just curious about Freebase then do come along and say hi.

One of the topics of conversation is sure to be the awesome prototype Freebase interface that David created, Freebase Parallax. Read the release notes and watch the video, it’s 8 minutes but it really gives you an idea of the power of Freebase.

Leave a Comment » | example, freebase, mashup | Tagged: , | Permalink
Posted by Will Moffat

Hang Firefox 3 on Mac with Firebug

July 4, 2008

This 2-line web page will hang Firefox 3 with Firebug on a Mac:

<body onload="debugger">
<img src="">

(With Firebug scripting enabled)

This completely hangs the Firefox user-interface, so you can’t access your other tabs. The only thing to do is a Force-Quit. I reported the bug but unfortunately I just don’t have the time and energy to learn how to fix it myself. Hoping somebody out there might have some useful insights.

1 Comment | bugs, javascript, problems | Tagged: , , , , | Permalink
Posted by Will Moffat

MQL: Finding the Wikipedia page for a Freebase Topic

November 27, 2007

Freebase contains many articles mined from the Wikipedia. For example, this page about Edinburgh.

You might want to show the Wikipedia page in your own web application. Given the Freebase topic ID, in this case /en/edinburgh

This MQL query will return the Wikipedia ‘curid’

[{
"id" : "/en/edinburgh",
"key" : [{
"namespace" : "/wikipedia/en_id",
"value" : null
}]
}]

Run in Query Editor

Result:
{
"code":"/api/status/ok",
"result":[{
"id":"/en/edinburgh",
"key":[{
"namespace":"/wikipedia/en_id",
"value":"9602"
}]
}]
}

The Wikipedia URL is then:
http://en.wikipedia.org/wiki/index.html?curid=9602

Update: You can find the Wikipedia article name + all the redirect names with this query but as far as I know there’s no way to distinguish between redirects and the current article name.

Leave a Comment » | example, freebase, mql, wikipedia | Permalink
Posted by Will Moffat

Tagging demo with Freebase Suggest

November 8, 2007

I whipped up a quick example of tagging with Freebase Suggest.

This is just the client-side user interface. Integration with an existing tagging system is left as an exercise for the reader ;-)

Screenshot of Tagging demo

12 Comments | example, examples, freebase, freebase-suggest | Permalink
Posted by Will Moffat

Freebase Suggest demos

October 14, 2007

As an excuse to avoid packing my suitcase (an activity which I detest about as much clothes shopping) I wrote a few examples for Freebase Suggest.

The live demos are on the Freebase Suggest project page.

(Geek note: The 3rd demo includes a first attempt at a Freebase MiniTopic plugin for jQuery. This is a really easy way to generate an infobox or summary of a Freebase topic for your own page)

Freebase Suggest in action

2 Comments | example, freebase, freebase-suggest, jquery | Permalink
Posted by Will Moffat

Freebase apps without cookies

August 9, 2007

Freebase just announced that

Within a week or so we will be removing the registration requirement in order to view Freebase.

Soon all my demo apps will work without requiring a Freebase invite. Cool!

Leave a Comment » | authentication, freebase, invites, mjt | Permalink
Posted by Will Moffat

Avoiding timeouts – Using MQL cursors with MJT

August 4, 2007

If you start to develop Freebase applications you then at some point you will inevitably see the error message “Query timeout”

For example, if you wanted to get a list of Musical Artists in Freebase you might try this query

{
“query”:[{
"id":null,
"limit":0,
"name":null,
"type":"/music/artist"
}]
}

But as there are almost 1/3 million artists in the database this query will timeout. That’s just as well, otherwise you would be loading a 30MB JavaScript file!

That was an extreme example, but as more users register with Freebase, my Map of Freebase Users occasionally timeouts. (It’s actually the MJT library which imposes the deadline here, not necessary the database which timeouts). Even if your application isn’t timing out, you find that your browser becomes unresponsive as it loads large JavaScript files from the database.

The solution is to use MQL cursors

I’ve created an example using MQL cursors in MJT which demonstrates a number of concepts:

  • Using MQL cursors
  • Calling MJT templates with arguments
  • Incremental queries (the page updates without reloading)

1 Comment | cursors, example, freebase, mjt | Permalink
Posted by Will Moffat

And we’re back

July 26, 2007

Our short caving expedition is already finished. The Canto system is now almost 80km long!

Luc in Cantabria

Leave a Comment » | spekul | Permalink
Posted by Will Moffat

« Previous Entries