definitely interested.

Posts Tagged ‘mapping’

You could just use pipes.

In various on February 5, 2009 at 3:31 am

Observation: I’m talking about feeding the borg here in a pretty big way. But I don’t know that I have it in me to totally DIY this.

Right now, when we post a new article, it is up to the editor to go through and identify all the hyperlinks that belong in the article. Then the web producer takes the article and runs it through some HTML filters and actually anchors those links. Someone, usually, produces a list of keywords. It is all a little arbitrary, the keywords part.

You might already know this, but arbitrary makes me insane. Seriously. I need structure. And, we’re working on doing a better job of covering elections and so one thing I want is a scheme for tagging stories about a particular district. Also, there are a lot of geographic news aggregators out there. EveryBlock, Outside.in and I’d like to get our stories onto their maps more consistently. And, we have these district pages about our elected representatives, and they’re pretty thorough, but instinctively writers and editors link off to electeds’ own home pages instead of our internal pages about them, which isn’t the end of the world but doesn’t do a very good job of keeping people on our site.

So what I want, is to take a story that is still raw, and process it a few times, in an automated sort of a fashion, before it gets laid out. I’d like, for instance, to search for places and geocode them. Search for elected officials and candidates and link to our own pages about those people. And at least on the geocoding front someone said I could “just use pipes.” And so I’m trying to figure out how that would work. I’m pretty sure it wouldn’t. I’m pretty sure I’d need to create a database of locations myself before Yahoo pipes would even begin to try to put the Adam Clayton Powell State Office Building or the Board of Elections on a map.

But that is what I’m thinking about.

Feed Me

In various on September 10, 2008 at 7:48 pm

Reposting from the IdeaLab. Most of what I write there is either drivel or a comment, and I think I write sharp comments but they’re not really that intriguing out of context. What I didn’t say on the idealab was that I’ve noticed these trends, one being a fascination with aggregation that comes early in a person’s introduction to the vast world of internet resources out there. Aggregation without human intervention. Aggregation like “what if you could subscribe to all the action alerts about polar bears in the whole world instead of engaging with an organization and building a long term strategy to help Americans rethink our relationship to nature.” Except that second clause gets lost in the translation. Also, the people who want to talk about emergent behavior and the wisdom of crowds. And then they show a picture of some bees, and they don’t point out that hives have Queen Bees. And Queen Bees posses intellectual superiority. So do good organizers. Just data, data without analysis, is not superior. It is just data. Smart people, maybe people with communities that make them smarter by challenging them, but smart people are the ones who make things happen. Is what I say, but didn’t say because somehow I don’t know how to say that in a language that is professional enough. This will forever be my challenge, I am guessing.

I spent Tuesday in Washington DC at Websites Without Walls. A nine hour trip for a four hour meeting always makes me nervous, but we’re passionately interested in seeing New York City match Washington DC’s astounding wealth of open public data. Never knew that the District publishes an astounding wealth of usable public information? Me neither. I made the trip to find out more.

While New York City busies itself posting PDFs of city agency documents within 10 days of their publication, the District of Columbia’s Office of the Chief Technical Officer is churning out no less than 261 live data feeds and maps, and has mandated that no city agency may acquire software that cannot publish to the data warehouse.

Two hundred sixty one and growing, while the British Government’s Power of Information Task Force is sponsoring a contest with a $35,000 prize to the best idea on “how to reuse, represent, mashup or combine the information the government holds.” To get folks started they’ve put together a comprehensive list of public data sources in the UK.

The data that Washington DC makes public is the same data that city agencies use internally every day. Unfortunately, it seems to be so obvious to the current administration that this is public information that they don’t have many insights about how other cities might find the political will to follow suite. One interesting observation: that DC has managed to sell the data warehouse as a way that the city can retain control over data. By providing the data as feeds that civic projects can re-purpose, the city has the power to correct data and see those corrections percolate out in a way they never could with figures published in hard copy.

Other tasty morsels from Websites Without Walls? NPR’s API is up and running and mighty robust, Stephanie was the most used word in congress on Monday.

Another challenge: I ran into a thousand people I know and love at the landing of the Swimming Cities of Switchback Sea on Sunday night. Because my old networks have come unraveled, I don’t really see Jenny or Joe Tuba or Ashira or Will or Aresh in any natural or organic way. And so I run into them at things like that and we say “it is so great to see you” and then we go back from whence we came. But in between they ask me what I am doing and I don’t know how to say that I’m obsessed with data driven local media. It doesn’t seem all that interesting with Swoon‘s work towering over us and the Swimming Cities rocking gently on the pier. I don’t know how to reconcile these things.

Visualize, Please

In various on July 23, 2008 at 6:39 pm

If you could vote here, which you can’t, I’d take a poll like

Many Eyes vs. Small Array

You’d vote Small Array, too. Don’t deny it.

via New York Shitty

I See You

In various on June 13, 2008 at 1:39 pm

I got all worked up about Many Eyes until I discovered that I couldn’t quite load any of the visualizations because my Java setup isn’t what it should be. Then I actually met someone from Many Eyes and got inspired to ask for advice. I got some:

One of our developers uses Ubuntu and here’s his Java set up: Sun-java6-plugin on Hardy in the multiverse. It can be installed via the package manager directly (sudo aptitude install sun-java6-plugin) or via Add/Remove Applications (“Sun Java 6 Runtime”). The info page on the package is here.

So now you can check out Many Eyes, too. Except that nothing is so simple. That plugin for Gutsy? It doesn’t exist.

Or it might. I’m really not sure.

http://packages.ubuntu.com/gutsy/i386/sun-java6-plugin/filelist

Civic Mashups

In various on March 12, 2008 at 5:21 pm

The People’s Production House is looking for programming help with a very cool project:

People’s Production House has been conducting interviews with people from across New York City to document their experience of the digital divide. This mash up will put these stories in context. It will locate 1) the location-specific audio recordings on a map of the city, overlaid with 2) data on Internet access (as gathered by the FCC, BroadbandCensus.com, and through our own research), 3) Internet infrastructure (as gathered by the NYC Economic Development Corporation), and 4) poverty levels (from the US Census) or other factors associated with lack of access to information technology. Over time, we would add in 5) other redlined resources, such as banks or healthy food. This will provide a clear representation of the digital divide — who it affects and how –– and tie it to other social issues. While this proposal is specific to New York City, I foresee it being used in many other cities, perhaps even internationally. It could be a great method of cultural exchange for people at any of the multiple edges of the growing network.

on the subject of magic wands

In various on September 11, 2007 at 8:16 pm

I’m puzzling madly over this.

How to get a chart to move over, then down. And over. Then down. It should be straightforward, but I can’t work it out. I’ve tried a lot of things. Read the rest of this entry »

Orwell, Come ‘n’ Get it

In various on July 17, 2006 at 5:35 pm


School officials in Sutter, Calif., order students to wear RFID tags around their necks; parents object and the principal backs down. School officials in Osaka, Japan, track students with radio frequency identification (RFID) tags worn around their necks or tucked in their belongings. The government of Mexico tracks court officials with RFID tags implanted in their shoulders. Finland changes national laws to allow cellphone tracking of children. A woman in Kenosha, Wisc., discovers her estranged husband has hidden a Global Positioning System (GPS) tracker in her car. All are current news items.

I know I should be expressing shock horror and outrage, but honestly? I would really like a little RFID tag rattling around in my downtube someplace, and possibly tucked away inside the case of my Thinkpad. $20/month might be pushing it, especially if that price is per chip, but I’d almost pay it.

As an aside, the article poses another interesting question about the potential for chips in workplaces, monitoring workers. Aside aside, it might be an improvement over the current USPS system which requires postal carriers to scan a bar code sticker at various set points along their routes, thus tracking their routes. Apparently the locations of these scanners are hard to keep track of, and so our local carrier has taken to scrawling “Scam Point” in magic marker on the outside of buildings containing such as bar code. Leaving aside the spelling issue, I’d love a solution that encouraged USPS carriers to keep their Sharpies capped. Back to my original aside, though, the article poses this food for thought: “Initially, the front line will be in the workplace. How will union leaders value workers’ rights with human tracking as a bargaining chip in contract negotiations?” which is positively fascinating becaues it assumes that union leaders are the ones out there valuing workers rights. I’m not saying they aren’t, but considering that less than 10% of the private workforce is unionized, at least in the US, it is going to take more than just union leaders to protect workers rights. Mostly, I am always bewildered by liberals who act like the Unions will save us as though the AFL-CIO had anything like the power they had in the 70s. Part of this little Orwellian dystopia that we are slip-sliding towards includes some strange doublespeak about how unions are looking out for us, and never ever mentions that we’ve collectively allowed our legislators to eviscerate workers rights and the power of most labor unions in the process.

And, PS, Yessss. I do realize that a dose of basic f*ing manners would go along way at the USPS. There is some middle ground between writing all over someone’s front door and implanting chips in mail carriers. I was being facetious, okay?

Mapping, and Thinking About Maps

In various on November 11, 2005 at 10:02 am

This is a thing I’d like to put more energy into …

http://civicmaps.org/?q=node/92

http://civicmaps.org/?q=node/91

http://civicmaps.org/?q=node/90

Eco Metropolis

In events, various on November 7, 2005 at 9:56 am

What: Eco-Metropolis 2005

When: 11/11/05

Where: CUNY Graduate Center, 365 5th Ave, New York, NY (at 34th St)

Eco-Metropolis 2005 Schedule as of 11/1/05

Read the rest of this entry »