elmcity project status

2013-10-18

Somebody wrote today noticing this space was silent and wondering if the project were also. Nope, it’s alive and well, I just haven’t been documenting it here.

The best summary of the current state of play is a screencast I made today.

2012-08-16

The URL pattern http://elmcity.cloudapp.net/ID — so, for example, http://elmcity.cloudapp.net/BlacksburgVA — now yields an About this Hub page into which I am organizing all the documentation.

Thanks to David Moore for suggesting this.

2012-08-15

The feed editor now has two more fields:

1. approved. Default: yes. Set to no if you want to keep track of a feed but you’re not yet ready to publish it.

2. comments. A place to narrate the status of a prospective or approved feed.

Thanks to David Moore for suggesting this.

2012-08-08

Curators can now map user-contributed tags to the curated hub taxonomy. For example, the Harris County Public Library in Houston uses a CMS that supports tags. Here are some they’ve used:

adult program
all ages
baby time
bilingual
book discussion
book sale

By default these show up in the tag picker in squigglies to indicated they are user-contributed and not curator-assigned:

{adult program}
{all ages}
{baby time}
{bilingual}
{book discussion}
{book sale}

As curator I would like events tagged {book discussion} and {book sale} to show up in the hub taxonomy’s books category.

Here is the existing record in the hub’s registry:

{
“url” : “http://hcpl.net”,
“feedurl” : “https://host4.evanced.info/harris/evanced/eventsxml.asp?dm=ical&ag=&et=&lib=ALL&nd=90&feedtitle=Multiple+Branch%3CBR%3ESchedule+of+Events&LangType=0”,
“source” : “Harris County Public Libraries”,
“category” : “library,hcpl”
}

I add a new element, catmap:

{
“url” : “http://hcpl.net”,
“feedurl” : “https://host4.evanced.info/harris/evanced/eventsxml.asp?dm=ical&ag=&et=&lib=ALL&nd=90&feedtitle=Multiple+Branch%3CBR%3ESchedule+of+Events&LangType=0”,
“source” : “Harris County Public Libraries”,
“category” : “library,hcpl”,
“catmap” : “http://jonudell.net/elmcity/catmap-houston-harris-library.json”
}

The URL points to:

{
“baby time” : “children”,
“bilingual” : “language”,
“book discussion” : “books”,
“book sale” : “books”,
“children’s program” : “children”,
“computer class” : “technology,classes”,
“esl/literacy” : “language,education”,
“family program” : “family”,
“gulf coast reads – book discussion” : “books”,
“gulf coast reads” : “books”,
“movie” : “film”,
“story time” : “books”,
“toddler time” : “children”,
“tweens” : “children”,
“young adult/teen program” : “children”
}

Now events with per-event tags from the left column show up in the categories defined by the right column.

It’s also possible to include a catmap directly, like so:

{
“url” : “http://hcpl.net”,
“feedurl” : “https://host4.evanced.info/harris/evanced/eventsxml.asp?dm=ical&ag=&et=&lib=ALL&nd=90&feedtitle=Multiple+Branch%3CBR%3ESchedule+of+Events&LangType=0”,
“source” : “Harris County Public Libraries”,
“category” : “library,hcpl”,
“catmap” : ” { ‘book sale’:’books’, ‘book discussion’:’books’, ‘movie’:’film’ } ”
}

Because this feature is advanced and rarely needed, the catmap is not (yet) available in the regular feed editing view. It is available in the Edit All Feeds view.

Note that (for now) the original user-contributed categories are preserved in squigglies. So, for example:

Mon 03:00 PM Popcorn and a Movie Harris County Public Libraries film, hcpl, library, {movie} … +

2012-07-17

The Facebook helper (at URL helpers) now accepts the URL of either a Facebook fan page or a Facebook group, and produces an iCal URL for (future) events in either of those places. Formerly only fan pages could have calendars, now (thanks to Burt Lum for pointing this out) group pages can too.

2012-07-16

The URL helpers page now includes a bookmarklet that extracts the Google Calendar iCal URL from a page that embeds a Google Calendar widget. Many thanks to David Moore for reminding me to do that.

2012-06-05

The default HTML rendering now adds an ellipsis (…) to items for which the iCalendar DESCRIPTION is non-empty, clicking the ellipsis expands to show the description inline.

2012-05-16

The scheduler now works in a different and more flexible way. Formerly there were two schedules: one for geographic hubs and another for topical hubs. A geographic hub is (typically) a mixture of non-iCal sources (Eventful, Upcoming, EventBrite, Meetup) and iCal sources. A topical hub only has iCal sources.

Formerly the geographic hubs were aggregated less frequently than topical hubs in order not to overtax the Eventful/Upcoming/etc APIs. But that meant that iCal sources for those hubs were aggregated less frequently than for topical hubs, which didn’t make sense.

Now all non-iCal tasks happen on one schedule, currently every 8 hours, and all iCal tasks happen on another schedule, currently every 2 hours.

(There’s actually a third schedule for regional hubs like MonadnockNH, which are virtual containers for sets of hubs.)

This means that if your hub is geographical and uses both non-iCal and iCal sources, then over the course of 8 hours it will update 5 times instead of 1 as formerly — that is, once for the non-iCal sources, and 4 times for the iCal sources.

2012-04-25

The Add to Calendar feature (behind the + in event listings) now includes Add to Facebook. This is so individuals can pluck events of interest off the calendar and socialize them with friends.

2012-03-27

I’ve just made a big change to the mechanism that coalesces events. Formerly it required an exact match for both date/time and title. I’ve been wanting to do a fuzzier match but hadn’t figured out a good approach, now I think I have. You won’t notice the effect unless you’re running a big hub with substantial overlap among various sources, but for hubs in that category — Boston, Seattle — it’s making a huge difference.

2012-02-22

There’s now an iCalendar filter for the LOCATION property of feeds. The URL helpers page shows how to use it to distinguish between home games and away games in a sports feed. (Thanks to Clif Hirtle whose socialhartford hub surfaced the need for this filter.)

2012-01-15

Each event rendered in the HTML view now provides an Add to Calendar link that moves the information to a personal calendar — currently two web-style apps (Google Calendar, Hotmail Calendar), plus all desktop-style apps that are iCalendar-aware (e.g. Outlook, Apple iCal). Additional web-style apps can easily be added as needed.

2011-12-21

There’s now a mechanism for bundling a set of location hubs to create a regional hub. For example, MonadnockNH bundles the following hubs: elmcity (Keene), Jaffrey, Fitzwilliam, Dublin, Hancock, Gilsum, Harrisville, Nelson, Marlborough, Peterborough, and for good measure Brattleboro Vermont.

Each of the bundles hubs exists and is curated independently. The regional hub is just a virtual container for them.

2011-12-08

There’s now a page of URL helpers — http://elmcity.cloudapp.net/url_helpers — that help curators build various kinds of special-case iCalendar URLs. Currently for: Facebook, iCalendar filtering, RSS+xCal, CSV, and HighSchoolSports.Net.

2011-11-02

HighSchoolSports.net is a very fruitful source of iCalendar feeds, not only for high schools but also for middle schools in some places. (Only US places, I guess.) If you use the Synch feature on the site it appears that you can only get team calendars in batches of 5 which is inconvenient. But there’s no real limitation. So if you want to take feeds individually or in groups (e.g., all basketball, including boys/girls and varsity/jv), you can. But if you want them all in a batch, which I’ve decided I do for now, here’s a way to form the all-in-one-feed URL:

http://elmcity.cloudapp.net/get_high_school_sports_url/SCHOOL/TZ

SCHOOL is a name like Cleveland-High-School-Seattle-WA which you’ll find by searching the site for your town.

TZ is one of ET, CT, MT, PT, AT (Alaska time), HT (Hawaii time)

So, for example, this:

http://elmcity.cloudapp.net/get_high_school_sports_url/Cleveland-High-School-Seattle-WA/PT

Yields this:

http://www.highschoolsports.net/ical.cfm?seo_url=Cleveland-High-School-Seattle-WA&teams=WA9810818446-1-1-1,WA9810818446-1-2-1,WA9810818446-1-4-1,WA9810818446-1-5-1,WA9810818446-1-11-1,WA9810818446-2-1-1,WA9810818446-2-1-2,WA9810818446-2-2-1,WA9810818446-2-2-2,WA9810818446-2-4-1,WA9810818446-2-4-2,WA9810818446-2-5-1,WA9810818446-2-5-2,WA9810818446-2-11-1,WA9810818446-2-11-2,WA9810818446-22-1-1,WA9810818446-22-1-2,WA9810818446-22-2-1,WA9810818446-22-2-2,WA9810818446-22-4-1,WA9810818446-22-4-2,WA9810818446-22-5-1,WA9810818446-22-5-2,WA9810818446-22-11-1,WA9810818446-22-11-2,WA9810818446-13-1-2,WA9810818446-13-2-2,WA9810818446-13-4-2,WA9810818446-13-5-2,WA9810818446-13-11-2,WA9810818446-3-1-1,WA9810818446-3-1-2,WA9810818446-3-1-3,WA9810818446-3-2-1,WA9810818446-3-2-2,WA9810818446-3-2-3,WA9810818446-3-4-1,WA9810818446-3-4-2,WA9810818446-3-4-3,WA9810818446-3-5-1,WA9810818446-3-5-2,WA9810818446-3-5-3,WA9810818446-3-11-1,WA9810818446-3-11-2,WA9810818446-3-11-3,WA9810818446-19-1-1,WA9810818446-19-1-2,WA9810818446-19-2-1,WA9810818446-19-2-2,WA9810818446-19-4-1,WA9810818446-19-4-2,WA9810818446-19-5-1,WA9810818446-19-5-2,WA9810818446-19-11-1,WA9810818446-19-11-2,WA9810818446-10-1-1,WA9810818446-10-1-2,WA9810818446-10-2-1,WA9810818446-10-2-2,WA9810818446-10-4-1,WA9810818446-10-4-2,WA9810818446-10-5-1,WA9810818446-10-5-2,WA9810818446-10-11-1,WA9810818446-10-11-2,WA9810818446-4-1-1,WA9810818446-4-2-1,WA9810818446-4-4-1,WA9810818446-4-5-1,WA9810818446-4-11-1,WA9810818446-5-1-1,WA9810818446-5-1-2,WA9810818446-5-2-1,WA9810818446-5-2-2,WA9810818446-5-4-1,WA9810818446-5-4-2,WA9810818446-5-5-1,WA9810818446-5-5-2,WA9810818446-5-11-1,WA9810818446-5-11-2,WA9810818446-44-1-1,WA9810818446-44-1-2,WA9810818446-44-2-1,WA9810818446-44-2-2,WA9810818446-44-4-1,WA9810818446-44-4-2,WA9810818446-44-5-1,WA9810818446-44-5-2,WA9810818446-44-11-1,WA9810818446-44-11-2,WA9810818446-6-1-1,WA9810818446-6-1-2,WA9810818446-6-2-1,WA9810818446-6-2-2,WA9810818446-6-4-1,WA9810818446-6-4-2,WA9810818446-6-5-1,WA9810818446-6-5-2,WA9810818446-6-11-1,WA9810818446-6-11-2,WA9810818446-23-1-1,WA9810818446-23-1-2,WA9810818446-23-1-3,WA9810818446-23-2-1,WA9810818446-23-2-2,WA9810818446-23-2-3,WA9810818446-23-4-1,WA9810818446-23-4-2,WA9810818446-23-4-3,WA9810818446-23-5-1,WA9810818446-23-5-2,WA9810818446-23-5-3,WA9810818446-23-11-1,WA9810818446-23-11-2,WA9810818446-23-11-3,WA9810818446-15-1-1,WA9810818446-15-1-2,WA9810818446-15-2-1,WA9810818446-15-2-2,WA9810818446-15-4-1,WA9810818446-15-4-2,WA9810818446-15-5-1,WA9810818446-15-5-2,WA9810818446-15-11-1,WA9810818446-15-11-2,WA9810818446-7-1-1,WA9810818446-7-1-2,WA9810818446-7-2-1,WA9810818446-7-2-2,WA9810818446-7-4-1,WA9810818446-7-4-2,WA9810818446-7-5-1,WA9810818446-7-5-2,WA9810818446-7-11-1,WA9810818446-7-11-2,WA9810818446-8-1-2,WA9810818446-8-2-2,WA9810818446-8-4-2,WA9810818446-8-5-2,WA9810818446-8-11-2,WA9810818446-14-1-1,WA9810818446-14-1-2,WA9810818446-14-2-1,WA9810818446-14-2-2,WA9810818446-14-4-1,WA9810818446-14-4-2,WA9810818446-14-5-1,WA9810818446-14-5-2,WA9810818446-14-11-1,WA9810818446-14-11-2,WA9810818446-9-1-1,WA9810818446-9-1-2,WA9810818446-9-2-1,WA9810818446-9-2-2,WA9810818446-9-4-1,WA9810818446-9-4-2,WA9810818446-9-5-1,WA9810818446-9-5-2,WA9810818446-9-11-1,WA9810818446-9-11-2,WA9810818446-12-1-1,WA9810818446-12-1-2,WA9810818446-12-1-3,WA9810818446-12-2-1,WA9810818446-12-2-2,WA9810818446-12-2-3,WA9810818446-12-4-1,WA9810818446-12-4-2,WA9810818446-12-4-3,WA9810818446-12-5-1,WA9810818446-12-5-2,WA9810818446-12-5-3,WA9810818446-12-11-1,WA9810818446-12-11-2,WA9810818446-12-11-3,WA9810818446-18-1-1,WA9810818446-18-1-2,WA9810818446-18-2-1,WA9810818446-18-2-2,WA9810818446-18-4-1,WA9810818446-18-4-2,WA9810818446-18-5-1,WA9810818446-18-5-2,WA9810818446-18-11-1,WA9810818446-18-11-2,WA9810818446-11-1-1,WA9810818446-11-2-1,WA9810818446-11-4-1,WA9810818446-11-5-1,WA9810818446-11-11-1&gamespractices=g&tz=PT

It’s long, but you can plug it into the feed editor and it’ll work.

2011-10-20

The feed editor now includes a tag cloud to help curators visualize the tag namespace. It’s a first step towards enabling curators to bulk-edit the tag namespace — i.e. rename tags, delete tags, as was possible in Delicious.

2011-10-19

Views are now available in ICS format as well as XML/RSS/JSON.

http://elmcity.cloudapp.net/socialhartford/services/ics?view=music&count=10

2011-10-18

The HTML view now coalesces events with the same title and start. A coalesced event merges the source names, urls, and tags of its sources. Here’s an example from Berkeley. The event comes from Eventful, Upcoming, and also the Berkeleyside calendar:

Wed 05:00 PM Gather Restaurant in Berkeley Hosts Lindencroft Farm Harvest Dinner on October 26 [ 1 ,  2 ,  3 ] berkeleyside, eventful, upcoming

2011-09-14

Event listings on Facebook pages are now available. For example, here is the Facebook page for the Blind Pig in Ann Arbor:

https://www.facebook.com/pages/Blind-Pig-Ann-Arbor-MI/57679984081?sk=events

To form an iCalendar URL from this, capture the id of the page: 57679984081

Then use this template:

http://elmcity.cloudapp.net/ics_from_fb_page?fb_id={_}&elmcity_id={_}

Swap in the page id for fb_id, and the hub id for elmcity_id. So if the page id is 57679984081 and the hub id is a2cal then the iCalendar URL is:

http://elmcity.cloudapp.net/ics_from_fb_page?fb_id=57679984081&elmcity_id=a2cal

You can test this by using the iCalendar validator at icalvalid.cloudapp.net. Go there, pop in your iCalendar URL, and check to see that events are found and that the text of the feed is as expected.

To search for Facebook pages, try this (swapping in your location):

http://elmcity.info/doublesearch/?q=site%3Awww.facebook.com%2Fpages+ann+arbor+mi

(Thanks to Clif Hirtle, curator for the socialhartford hub, for suggesting this!)

2011-09-01

Two more authentications: Windows Live and Google.

2011-08-24

Facebook authentication is now available too. New curators will choose between Facebook and Twitter. Existing curators can ask to be converted to either of these methods.

2011-08-18

Curators can now sign in using the Twitter accounts associated with their hubs in order to directly edit hub configurations and add/edit/delete feeds.

If you have an existing hub the Delicious mechanism will continue to work, there is no need to change, but if you want to use the new integrated hub and feed editor just notify me (jonu@microsoft.com) and I’ll switch you over. If you haven’t already linked a Twitter account to your elmcity hub, let me know which one you’d like to use.

2011-06-02

Facebook events can now be syndicated, as well as searched for. Details.

2011-01-10

With build 986 the HTML rendering embeds RDFa markup that will enable events to be recognized by search engines.

It also includes latitude/longitude coordinates in the XML and JSON feeds.

(See this blog post for the rationale.)

2010-10-20

Build 867 adds parsing for RSS feeds that include structured calendar data in the xCal namespace. Some example URLs that produces this type of feed, from sites that use zevents.com:

http://calendar.bellinghamherald.com/search?city=Bellingham&new=n&rss=1&srad=90&svt=text&swhat=&swhen=&swhere=

http://events.pressdemocrat.com/search?city=Santa+Rosa&new=n&srad=90&svt=text&swhat=&swhen=&swhere=&cat=3&rss=1

To activate the xCal -> iCalendar translator for feeds of this type, bookmark them with the usual trio of tags:

trusted ics feed

and then also add this key/value pair:

xcal=yes

Note that the second example uses cat=3 which, in this context, means Business/Tech. It appears that for zevents.com-based sites, an elmcity curator can produce multiple tagged feeds by naming the categories. So for example, if you bookmarked the above pressdemocrat feed you could tag it with category=business and do likewise for all the other categories.

2010-09-27

Current build is 856. Many internal improvements since last update, but the key user-visible change is:

http://elmcity.cloudapp.net/delicious_check

This helps new curators verify that a delicious account is properly set up to control an elmcity hub. It’s also a useful way for established curators to review settings in delicious, the permanent record of those settings stored in Azure, and the current set of trusted feeds.

2010-08-04

As of build 777, the source code is released and I’ve begun a series of articles about the development of the project.

Among other recent activities, I’ve been reviewing how curators are including the default HTML rendering in their sites. Sourcing the HTML into an iframe is a popular approach, as seen for example on berkeleyside. In that situation you’d probably like to suppress the calendar’s header image, since the enclosing page already has one. This was formerly only possible by redirecting to an alternate template, but a lighter solution is now available: use header_image=no in your metadata.

Another strategy for sourcing events into a web page can be seen at InMenlo, where the combined ICS feed from the elmcity aggregator is routed back through Google Calendar, and the results sourced into the page. I’ve noticed a lot of duplicate events in that presentation, and I theorize that it’s happening because the IDs I’ve been generating were unique but not stable on a per-event basis across aggregator runs. So I’ve switched to a strategy that will produce stable unique IDs and will watch what happens. Even if I’m right, it may take a while for the duplicates to scroll off the event horizon.

2010-06-25

Given the hiatus since 607, build 659 clearly includes a lot. Much is internal, as I prepare to release the code as open source. But at least these things are visible:

1. New http://elmcity.cloudapp.net homepage, with these improvements: a) /services/ID is now, instead of 404, a helpful document that names and explains all the subsidiary links b) replacement of the dropdown list with a link to a). (/via Rob Goodspeed)

2. tags now link to category views For example, if an event is in the category music, then the default rendering links music to an url like http://elmcity.cloudapp.net/services/elmcity?view=music (/via Bill Rawlinson)

3. Facebook is now an event source. See: http://blog.jonudell.net/2010/05/07/facebook-is-now-an-elmcity-event-source/.

2010-03-02

Build 607 introduces the new iCalendar validator which Doug Day, who is also the author of the iCalendar component I am using, has graciously provided.

On the stats page now — for example, http://elmcity.cloudapp.net/services/prescottaz/stats — the column formerly labeled valid? is now labeled score. The score is a number from 0 to 100, which nicely represents the idea that the validity of a calendar feed is, practically speaking, not a binary yes/no but rather a point along a continuum.

If you click a value in that column, you’ll invoke the validator for the corresponding feed.

Alternatively, if you want to check the validity of a feed, you can do it directly at http://icalvalid.cloudapp.net.

2010-02-26

Build 605 includes few if any curator-visible changes, but much internal improvement. Especially in the areas of caching and service self-monitoring.

2009-11-09

Build 556 adds a major new source of events for all geographic hubs: Eventbrite. It works the same way as the Eventful and Upcoming sources, and happens automatically, curatators don’t have to do anything extra or different.

2009-10-22

Build 540 adds two new administrative features for curators: log viewing, and metadata viewing.

1: Log viewing

The URL pattern for the log viewer is:

http://elmcity.cloudapp.net/logs/{id}/{minutes}

So, for example, here’s the last 60 minutes of activity for the Keene hub:

http://elmcity.cloudapp.net/logs/elmcity/60

If minutes is more than 500, it’ll become 500.

2: Metadata viewing

The URL pattern for the metadata viewer is:

http://elmcity.cloudapp.net/metadata/{id}

You wouldn’t normally need this. But if you want to make sure that the metadata you’ve specified in Delicious has been accurately and completely transmitted to the elmcity service, you can use this URL to check. It retrieves the mirror of your Delicious metadata that’s stored in an Azure table, plus some computed or looked-up values that aren’t in Delicious:

• events
• population
• feed_count

If you have made a change to your Delicious metadata, you might want to send a Twitter start message to the service in order to start a new cycle. You can watch its progress in your log viewer. Look for entries like these:

 8:53:45 PM info 5872,RD00155D301CF7: Scheduler.StartTaskForId: eLearningEvents 
 8:53:45 PM info 5872,RD00155D301CF7: processing hub: eLearningEvents 
 8:54:03 PM info 5872,RD00155D301CF7: DoIcal: eLearningEvents 

Once you see DoIcal, your metadata should be synched to Azure. You can check your metadata URL to verify.

2009-10-21

Build 538 adds the ability for curators to short-circuit the normal cycle and start a new one. You do this by sending a Twitter direct message to @elmcity_azure. If the message says:

start

then your cycle will restart within 5 minutes.

2009-10-06

Major changes in build 516:

Improved calendar widget in HTML views
The new version, based on the JQuery datepicker, stays in a fixed position as you scroll, and ajusts itself to the closest displayed date.

Hubs using the default template will see this new behavior. Hubs that have altered the default template may want to resynch with it.

RSS views
The following flavors work:

1. http://elmcity.cloudapp.net/services/elmcity/rss

2. http://elmcity.cloudapp.net/services/elmcity/rss?view=government

3. http://elmcity.cloudapp.net/services/elmcity/rss?count=30

4. http://elmcity.cloudapp.net/services/elmcity/rss?view=music&count=10

This flavor should be especially useful for systems, like WordPress.com, that will not display dynamic content but will display RSS feeds. You can see example 4 in action on my blog (scroll down to “Upcoming music in Keene”).

2009-09-16

Build 452 adds new standard views for tag summaries (as HTML and as JSON). So for example:

http://elmcity.cloudapp.net/services/elmcity/tags_html

http://elmcity.cloudapp.net/services/elmcity/tags_json

or

http://elmcity.cloudapp.net/services/elmcity/tags_json?jsonp=tags

2009-08-25

Build 441 includes WHERE and WHAT hubs on the homepage, and streamlines the display of all associated links.

2009-08-06

Build 430 converts internally to UTC times. This mainly benefits topical hubs, since their events cross timezones. The data feeds — XML, JSON, iCalendar — are now all expressed in terms of UTC.

For geographical hubs, the data feeds are also expressed in terms of UTC. However, the HTML view converts to local time as defined by the tz= metadata slot. Since geographical hubs are only using the HTML view, and none (I think) are using the data feeds, there should be no observable change.

2009-07-23

Build 420 adds a new axis of aggregation: topic rather than geographic location.

The mechanism is similar. Basically just what= instead of where= in the delicious metadata.

The first two examples are:

http://delicious.com/eLearningEvents

http://delicious.com/SustainabilityInBusiness

In these cases, there is no aggregation from Eventful and Upcoming, because there is no location. So it’s purely aggregation of a list of iCalendar feeds, which are handled in the usual way.

These topic aggregations aren’t yet reflected on the home page. But you can find them here:

http://elmcity.blob.core.windows.net/sustainabilityinbusiness/SustainabilityInBusiness.html

http://elmcity.blob.core.windows.net/elearningevents/eLearningEvents.html

Similarly for .xml, .json, .ics.

(The directory names is all lowercase. The filenames are whatever you’re using on delicious — most folks use lowercase, but mixed case is possible and both of these are that way.)

2009-06-16

Build 396 tweaks the default HTML rendering. With each day, events are now grouped by these time-of-day labels: Morning, Lunch, Afternoon, Evening, Night, WeeHours.

2009-06-10

Build 390 starts to make category-based views available. The supported types so far: html and xml.

Example URLs:

http://elmcity.cloudapp.net/services/elmcity/xml/sports

http://elmcity.cloudapp.net/services/prescottaz/html/government

http://elmcity.cloudapp.net/services/whyhuntington/html/nightclub%20scene

Any or all of the categorization methods discussed previously can contribute to these views.

Not yet supported:

http://elmcity.cloudapp.net/services/whyhuntington/html/music,fine-arts

(And not yet decided: Does that mean music AND fine-arts? Or music OR fine-arts? And either way, how to express the alternative.)

Bill R: You have some slash-delimited categories, e.g.:

Fairs/Festivals

Those won’t work.

2009-06-05

Build 388 adds a fourth way to categorize events. In any iCalendar app, you can now use these patterns in the Description field:

url=http://www.harlowspub.com

category=music,bluegrass

This is particularly useful for recurring events. As discussed here, recurring events are a great way to build critical mass because your curation effort keeps paying dividends.

One of the events I found when exploring the search page for Keene is the Monday night bluegrass jam at Harlow’s Pub.

Here’s the description I entered into Windows Live Calendar — which also could have been entered into Google Calendar, or any other iCalendar app:

“The Birch Benders host a Bluegrass picking party at Harlow’s Pub in Peterborough every Monday night – 8 pm until they kick us out (11 or so). url=http://www.harlowspub.com category=music”

Here’s the rendered result:

Mon 08:00 PM Bluegrass night with the Birchbenders (recurring events (live)) (music)

The url=… and category=… patterns can occur anywhere in the description.

I hope this not only opens some doors w/respect to categorization, but also w/respect to finding and adding recurring events, which are a very powerful way to build up critical mass.

2009-06-04

With build 386, we have 3 ways to categorize events:

1. If a source iCalendar feed uses the CATEGORIES property, they’ll be included.
2. If all of the events from a feed can be categorized, you can name that category in the Delicious metadata, using category=CATEGORY. All events from the feed will inherit it  in the same way that they all inherit the default clickthrough link specified with url=URL.
3. If all of the events from an Upcoming or Eventful venue can be categorized, you can also name that category in the Delicious metadata. To do that, bookmark the venue URL and use the patterns venue={UPCOMING|EVENTFUL} and category=CATEGORY.

See today’s blog entry for a more detailed explanation.

2009-05-14

Build 335 addresses a problem that Dave Witzel noticed when he used Google Calendar as a viewer for the Falls Church combined ICS feed.

The problem was lack of context around the displayed event. The (imperfect) solution, discussed in this blog post, copies the URL for the event (or the default URL, from the url= tag in the delicious metadata), into the LOCATION field.

The blog post has the whole story.

2009-05-04

Build 324 adds a service to help curators (or anyone) extract the ICS URL from a web page with an embedded Google Calendar. The writeup is here. The bookmarklet that uses the service is here. To use it directly, for a page like http://www.huntingtoncommunitygardens.com/8.html, do this:

http://elmcity.cloudapp.net/gcal2ics/www.huntingtoncommunitygardens.com/8.html

In other words: http://elmcity.cloudapp.net/gcal2ics/ plus the URL of the calendar page without its leading htttp://

2009-04-16

Build 313 introduces a major new feature for curators. Read all about it here — A power tool for curators — and let me whether you’re able to make use of it.

2009-04-10

The first version of the project FAQ is done. If you know somebody who’s interested in becoming a curator, that page has the information you need.

For a gentler introduction, you can point them to this blog entry which describes the minimal setup required to bootstrap an instance of the calendar aggregator for a location.

2009-04-08

To the extent that most people ever subscribe to ICS feeds at all in their personal calendars, I think the best strategy will be to use the aggregator as a conduit to individual feeds that you might want to subscribe — the hockey schedule, the nightclub schedule.

However, build 298 does now publish the merged set of events for each location as a single ICS feed. I’ll be very interested to know who uses these, and how.

I suspect that experiences will vary according to event density. Adding an ICS overlay for Keene into my Outlook calendar actually does seem to be useful, at the current event density. It may already be overwhelming for Ann Arbor or Baltimore.

In any case, the densities will (hopefully) increase for all locations. So I think in the long run the best use of the aggregator will be to collect and promote discovery of individual feeds.

2009-04-07

Build 295 lays the foundation for per-location iCalendar feeds that merge all sources of events for each location, but does not yet publish those feeds.

The visible change is on the home page, where events, population, and events/person are now reported. Because these are future events, the numbers change even if no feeds are added. I’d like to include a sparkline in the summary table to visualize those trends.

2009-04-03

Today’s version, build 287, focuses on stats reporting. The per-location changes are:

1. Total events
2. Population
3. Ratio of the two

So, for example, this is mashablecity (Providence RI) today:

All events 910, population 48779, events/person 0.02

The per-feed changes are:

1. If a feed fails to validate, False (in the Valid? column) is a link to the full validation report
2. Validation errors are captured and reported
3. Loading errors are captured and reported
4. The PRODID (Product ID) of the software that wrote the feed is reported.

2009-03-30

Build 281, deploying now, is the first fully data-driven version. From now on, I should not have to touch any code to add a new city. The workflow is:

1. A new curator claims a delicious account, as Matt Gillooly just did with delicious.com/mashablecity.
2. I bookmark that URL in my own delicious account, using the tag calendarcuration.
3. On the next cycle, the system queries http://delicious.com/judell/calendarcuration, finds one more curatorial account than before, and rolls it in.

In doing this, I sorted out what the minimal requirement is for account metadata. It is simply — in Matt’s case  — the where slot:

where=providence, ri

Everything else is a slot that you can override from the following defaults:

tz=Eastern

title=event+calendar

contact=nobody_yet

img=http://elmcity.info/media/img/keene-night-360.jpg

css=http://jonudell.net/css/elmcity.css

template=http://jonudell.net/tmpl/events.tmpl

lat={computed from where}

lon={computed from where}

radius=5

2009-03-27

This version makes the “today’s events” widgets on the home page dynamically selectable. With more locations on board, it will be interested to be able to compare any two, side-by-side, for a given day.

2009-03-20

The version deploying now includes these changes:

• CSS. Although the rendered HTML is only meant as a reference implementation — to be replaced with stuff like Bill’s doing here, it didn’t need to be quite so butt ugly.
• Baltimore. I’ve added a fourth collection for localist. It’s currently Eventful+Upcoming only, no iCalendar, pending adjustment of the feed tags. Radius is 5 miles because 15 was overwhelming.
• Metadata. I’m persisting the Delicious metadata into the Azure tablestore. Although Delicious is convenient, not everyone will want to use it. Ed Vielmetti in Ann Arbor would rather use a semantic wiki, which is great. The backend will be a neutral repository for various metadata formats, just as the aggregator is a neutral hub for various calendar formats

With 4 locations running, the update cycle is pushing toward an hour. It won’t be too long before I start running out of hours in the day. But that’s what makes this a nice Azure experiment. The work is naturally divisible and distributable. I’m starting to think about how to hand out tasks to a pool of workers, and coordinate them. Really looking forward to that part, it’ll be interesting!

2009-03-17

While implementing Bill’s fix, I found and fixed several problems that were causing both Eventful and iCalendar events to be omitted. So all calendars are now more complete.

I also improved the iCalendar stats page. Now there’s a complete accounting of single events, recurring events, instances of recurring events, and future events.

2009-03-16

Bill Rawlinson noticed that the per-feed links weren’t working. That’s because although I defined the metadata mechanism, and he implemented it at http://delicious.com/whyhuntington, I had neglected to actually wire it up! Thanks for noticing, Bill, I’m testing the fix now.

The idea is as follows. Some iCalendar feeds include per-event URLs but many do not. In those cases, we can specify a catch-all link for the feed. Since the feed will already be bookmarked in Delicious, you can do that by adding a name=value tag like so:

url=http://www.wvpumpkinpark.com/pp-calendar.asp

> I’m testing the fix now.

Hmm. The test triggered the Delicious rate limit. Which is OK, I’ve been needing to implement caching of external services anyway. So now I will.

2009-03-15

The aggregator now includes Upcoming events in and around your location. This feature is controlled by three tags on the metadata URL in your Delicious account. From the Keene example:

radius=15

lat=42.9336

lon=-72.2786strong>2009