GeoNetwork, Me, and a Rubber Mallet (Pt. 5)
Eesh. So many, many months ago we began chopping at the guts of the open source GeoNetwork project (GN), with the intent of building a much cleaner, more fluid, more approachable front end to the GN platform. Why? Well, because the back end handles a lot of stuff well already, including all of the forms for metadata input; the external submit function (most importantly, probably, from ArcCatalog); and of course the lucene indexing of that content. More than that, probably, is the built-in harvestability and harvestable…ness (the ability to both harvest via CSW or directly from other GN nodes and be harvested by same). In other words, GN does a lot of the stuff already that any metadata catalog would need to do. Its problem, in my estimation, was a rather ugly and cumbersome GUI, something we set out to fix with a combination of more minimalistic styles, OpenLayers, TileCache, and a lot of brush clearing in the tangle of .xsl files that actually comprise the default GN GUI.
I wrote about this a little (not as much as I intended, of course), then had to set it aside as various other projects repeatedly pulled rank (that’s the sad truth of being a librarian, by the way: your own work is usually subsumed by funded projects on which you’re just a cog or supporting player). It had a lot of potential to not only solve a campus need for better spatial data distribution, but also become a node in The Libraries’ burgeoning master plan for data curation (not to mention further that all of this is supposed to blossom into a campus resource that various proposals to various funding agencies may cite as at least partial fulfilment of data curation requirements). Armed with just an undergraduate student worker (~10 hours/wk) and whatever time I could scrape together at night, I was able to get a working prototype that looked like this:
And it worked! It’s a largely untouched back end (except for some customization of the *index-fields.xsl files) plus a heavily customized front end that swapped out InterMap (wtf is InterMap?) with OpenLayers and ran all renderable layers through TileCache for better repeat performance. We also had a script that ran as a cron job that would pre-configure TileCache each night so all layers were ready for the day to come. (We didn’t quite get around to seeding the TileCache, however).
But the writing was on the wall almost from the start. The native GN GUI is a pretty rigid mess of Jeeves-run java services that output xml that filter through xsl for styling and presentation. Guess what? All of that garbage doesn’t exactly lend itself to swift and efficient web dev. Meaning it took a lot of effort just to get where we got and any future functionalities and fanciness was going to come at a price — more and more of our blood and time.
So late last semester I finally pulled the plug on the customized GUI version (yes, before we ever even released an alpha of what we had worked so hard on) and split for more manageable waters. And I’m here now to announce the new name in this series, draw out the new stack of technologies, and renew a promise to document the process better than before.
New name: GeoNetwork, Solr, OpenLayers, Me, and Rubber Mallet.
New stack: GN -> Lucene -> Solr -> OpenLayers/jQuery/PHP.
The new plan — just about caught up to our previous work already — is to simply use GN as-is for admin only. It will harvest, be harvested, edit and index metadata as it was meant to do. In front of that we have Apache’s Solr running, feeding on GN’s native Lucene index. This allows us to be much more flexible at every stage down the line from there, and the first place this has paid off is what I’ll write about next time — pulling records out of GN’s database (mysql), using Solr, as JSON responses in a homemade OpenLayers/jQuery/PHP web app (here’s a preview: it’s about 10 times easier than fucking with all of those xsl stylesheets).
May 28th, 2009 at 9:28 am
Thanks for posting. I believe I have heard of this project through the GN mailing list quite a while ago. Actually, I believe there were several projects focused on the GN front end.
I totally agree with what you’re saying. That’s why for the repositories I’m working on, I use Drupal CMS as my front end. It’s a PHP/MySQL app with integrated jQuery, and does a great job handling user management/permissions. I use Apache Solr behind the scenes, which Drupal supports as well (better support coming very soon.) With Drupal modules such as CCK, Views, linkages with OpenLayers and Google Maps API for WMS services, and others, it gives me a lot of control. Of course, it already does a great job separating style from content and easily allows me to apply theme/style from my main websites to my catalogs.
However, I am not integrating the back end Drupal database with a harvesting engine. I believe Drupal does support OAI-PMH but replicating data into a database that supports direct harvesting and/or CSW would be nice. At least CSS. Of course, if your data is found through search engines like Google, you have to ask yourself how important is harvesting to your mission? I’m going through those questions right now.
Just curious but do you run any internal map servers, like MapServer or GeoServer? Also, have you looked at deegree as a back end? I like GN as well, esp 2.4 with supposedly improved CSW support.
Good luck!
February 3rd, 2010 at 7:05 pm
Really admire the work your are putting in. It must have been hard to dump the previous plan, but for my two cents, it was the right decision. Hope it all goes to plan. I’ll be cheering from the sides.
Good Luck!
February 7th, 2010 at 8:24 pm
Dumb question time. Why use Solr and the lucene index? why not use CSW to query the geonetwork repository?
Using CSW would seem to be more portable and uncoupled form the lucene index. I understand though that there are some deficiencies in the current implementation of CSW in geonetwork.
February 7th, 2010 at 9:42 pm
Not dumb at all (I hope), since we actually started out with CSW. But Solr is attractive because it has a lot of extra power behind it in its faceted results, multiple index support, etc. We’re ultimately planning to do some interesting pre-query parsing to situate the query string in a given domain (and thus a pre-filtered resultset), since this will support many different disciplines who may be looking for quite different things. That’s the idea, anyway. CSW was already pretty finicky when we were testing it and Solr came out of the box with JSON — it just looked so much easier to work with.
October 21st, 2010 at 11:30 pm
[color=red][url=http://000site.ru/go.php?sid=9]>>> ÌÍÅ ÅÑÒÜ 18 ËÅÒ <<<[/url][/color]
[url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/195.jpg[/img][/url] [url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/17.jpg[/img][/url]
[url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/35.jpg[/img][/url] [url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/64.jpg[/img][/url]
[url=http://llvl-320.npoln.is.com/fpv_koreiskoe-porno.html]Êîðåéñêîå Ïîðíî[/url]
[url=http://death-death.npoln.is.com/lpq-www-porno.html]Www Porno Lv[/url]
[url=http://blog-blog.npoln.is.com/9_video-porno.html]Âèäåî Ïîðíî Ïðèíóæäåíèå[/url]
[url=http://woomen-woomen.npoln.is.com/fbq_foto-goryachih.html]Ôîòî Ãîðÿ÷èõ Ïîïîê[/url]
[url=http://www.oqdxk.is.com/2_amateur-porno.html]Amateur Porno[/url]
[url=http://them-them.oqdxk.is.com/3_gotika-seks.html]Ãîòèêà Ñåêñ Ôîòî[/url]
[url=http://eye-eye.oqdxk.is.com/1-pered-analnym.html]Ïåðåä Àíàëüíûì Ñåêñîì[/url]
[url=http://wide-28.oqdxk.is.com/vj-horoshie-telki.html]Õîðîøèå Ò¸ëêè[/url]
[url=http://jimocz-489.oqdxk.is.com/cky-porno-foto-znaminitostei.html]Ïîðíî Ôîòî Çíàìèíèòîñòåé[/url]
[url=http://950-deep.oqdxk.is.com/7-seks-foto.html]Ñåêñ Ôîòî Êîðîëåâîé Íàòàøè[/url]
[url=http://vcklri-971.oqdxk.is.com/7-seks-negrityanochki.html]Ñåêñ Íåãðèòÿíî÷êè[/url]
[url=http://great-fvd.oqdxk.is.com/]Ñåêñ Ì Íîâîãèðååâî – ïîðíî ðîëèêè îíëàéí[/url]
[url=http://54-zwf.oqdxk.is.com/ovk-roliki-oralnyi.html]Ðîëèêè Îðàëüíûé Ñåêñ[/url]
[url=http://127-oycatc.oqdxk.is.com/idz-tolstye-negrityanki-porno.html]Òîëñòûå Íåãðèòÿíêè Ïîðíî[/url]
[url=http://paper-paper.oqdxk.is.com/1-porno-cartoons.html]Ïîðíî Cartoons[/url]
[url=http://pgl-487.oqdxk.is.com/11_foto-ogromnoi-vaginy.html]Ôîòî Îãðîìíîé Âàãèíû[/url]
[url=http://399-pro.oqdxk.is.com/veb_seksy-fighting.html]Ñåêñû Fighting Ballbusting[/url]
[url=http://iqar.oqdxk.is.com/kw-kazanskii-seks.html]Êàçàíñêèé Ñåêñ[/url]
[url=http://mpr.oqdxk.is.com/1-prikolnoe-porno-video.html]Ïðèêîëüíîå Ïîðíî Âèäåî[/url]
[url=http://41-dqib.oqdxk.is.com/kb-porno-tachki.html]Ïîðíî Òà÷êè[/url]
[url=http://663-evi.oqdxk.is.com/2-zhestkoe-porno-anime.html]Ƹñòêîå Ïîðíî Àíèìå[/url]
[url=http://899-long.oqdxk.is.com/yv-porno-foto.html]Ïîðíî Ôîòî Âåðîíèêè[/url]
[url=http://zzd-909.oqdxk.is.com/4_intim-seks.html]Èíòèì Ñåêñ ×åëÿáèíñê[/url]
[url=http://gag-750.oqdxk.is.com/dnv_porno-foto-galerei-zrelye.html]Ïîðíî Ôîòî Ãàëåðåè Çðåëûå[/url]
[url=http://quite-quite.oqdxk.is.com/5-tatricheskii-seks.html]Òàòðè÷åñêèé Ñåêñ[/url]
[url=http://59-ltymx.oqdxk.is.com/6_zanyatiya-tantricheskim.html]Çàíÿòèÿ Òàíòðè÷åñêèì Ñåêñîì[/url]
[url=http://456-on.oqdxk.is.com/4-seks-cherez.html]Ñåêñ ×åðåç Äûðêó Ñòåíîé[/url]
[url=http://ten-rybndm.oqdxk.is.com/]Êóïëþ Ïîðíî Ôîòî – ïîðíóõà âèäåî-ðîëèê ñêà÷àòü[/url]
[url=http://ezzp-sight.oqdxk.is.com/4_russkii-seks.html]Ðóññêèé Ñåêñ Ôîòîãðàôèè[/url]
[url=http://jbj.oqdxk.is.com/10-erotika-video.html]Ýðîòèêà Âèäåî Ðîëèêè[/url]
[url=http://now-731.oqdxk.is.com/]Ñåêñ Ïîðíî Ìàìà Ñûí – ïîðíî ðîëèêè îíëàéí[/url]
[url=http://outside-jhlu.oqdxk.is.com/bu-seks-sho.html]Ñåêñ Øî[/url]
[url=http://house-zgfidk.oqdxk.is.com/1_posmotret-chastnoe-porno.html]Ïîñìîòðåòü ×àñòíîå Ïîðíî[/url]
[url=http://if-951.oqdxk.is.com/4_porno-bolshie-piski.html]Ïîðíî Áîëüøèå Ïèñüêè[/url]
[url=http://348-info.oqdxk.is.com/1_seks-video.html]Ñåêñ Âèäåî Ñî Çíàìåíèòîñòÿìè[/url]
[url=http://year-inzm.oqdxk.is.com/]Ñåêñ Êèíî Ïðîäàæà – ïîðíî ðîëèêè ñìîòðåòü[/url]
[url=http://boad-rsxtyi.oqdxk.is.com/4_porno-anal.html]Porno Anal Oral[/url]
[url=http://will.oqdxk.is.com/]Ñåêñ Ñî Ñòàðøåé Ñåñòðîé – ïîðåâî âèäåî ñêà÷àòü[/url]
[url=http://803-ptzvm.oqdxk.is.com/kkn_obscenie-lubov-seks.html]Îáùåíèå Ëþáîâü Ñåêñ[/url]
[url=http://listen.oqdxk.is.com/pv-ryjie-telki.html]Ðûæèå Òåëêè[/url]
[url=http://esipii-48.oqdxk.is.com/8-porno-sujet.html]Ïîðíî Ñþæåò[/url]
[url=http://become-become.oqdxk.is.com/yw-porno-klipi.html]Ïîðíî Êëèïè[/url]
[url=http://gqah-519.oqdxk.is.com/pz-zagruzki-pornuhi.html]Çàãðóçêè Ïîðíóõè[/url]
[url=http://feet.oqdxk.is.com/kg-oboi-krasivaya.html]Îáîè Êðàñèâàÿ Ýðîòèêà[/url]
[url=http://npvf.oqdxk.is.com/9-porno-seks.html]Ïîðíî Ñåêñ Òóò[/url]
[url=http://225-wfddy.oqdxk.is.com/3_piski-golyh-parnei.html]Ïèñüêè Ãîëûõ Ïàðíåé[/url]
[url=http://lzmqp-will.oqdxk.is.com/5_foto-seks-telki.html]Ôîòî Ñåêñ Òåëêè[/url]
[url=http://dqlrir-three.oqdxk.is.com/yx-klassika-erotiki.html]Êëàññèêà Ýðîòèêè[/url]
[url=http://young-982.oqdxk.is.com/jj_porno-adriana.html]Ïîðíî Àäðèàíà[/url]
[url=http://442-wyues.oqdxk.is.com/5_realnye-semki-seksa-skrytoi-kameroi.html]Ðåàëüíûå Ñúåìêè Ñåêñà Ñêðûòîé Êàìåðîé[/url]
[url=http://ccbsh-remote.oqdxk.is.com/1-seks-elena.html]Ñåêñ Åëåíà Áåðêîâà[/url]
[url=http://see-662.oqdxk.is.com/pp_drochit-porno.html]Äðî÷èò Ïîðíî[/url]
[url=http://father.oqdxk.is.com/1-porno-roliki.html]Ïîðíî Ðîëèêè Áåç Âèðóñîâ[/url]
October 21st, 2010 at 11:47 pm
[color=red][url=http://000site.ru/go.php?sid=9]>>> IIA ANOU 18 EAO <<<[/url][/color]
[url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/144.jpg[/img][/url] [url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/140.jpg[/img][/url]
[url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/35.jpg[/img][/url] [url=http://000site.ru/go.php?sid=9][img]http://91.212.210.176/sites-images/movie/images/photos/117.jpg[/img][/url]
????? ??????? ???????
????? ?????? ?????? ?????
fist porn com index htm
???????? ??????? ?????
???? ?????
???? ?????????? ?????
???? ?????? ???????????
?????? ????
???? ??????????
????? ?????? ????
[url=http://right-right.npoln.is.com/8_porno-erotika.html]????? ??????? ?????????[/url]
[url=http://either-either.npoln.is.com/4-porno-video.html]????? ????? ???????[/url]
[url=http://ttdmma-147.npoln.is.com/1_video-erotika-seks-shahzoda.html]????? ??????? ???? Shahzoda[/url]
[url=http://desk-xoovn.npoln.is.com/kr-masaj-sisek.html]????? ?????[/url]
[url=http://gag-n-gape-sycu.npoln.is.com/4-porno-history.html]Porno History[/url]
[url=http://755-fimk.npoln.is.com/2-porno-ilony.html]????? ?????[/url]
[url=http://828-ecvnrd.npoln.is.com/4-porno-roditeli.html]????? ????????[/url]
[url=http://vav-299.npoln.is.com/]??????? ???? – ??????? ?????? ???????[/url]
[url=http://ekwsd.npoln.is.com/9_3-d.html]3 D Sex Villa[/url]
[url=http://show-xvfex.npoln.is.com/vzv-porno-seks-foto-zvezdy.html]????? ???? ???? ??????[/url]
[url=http://906-eat.npoln.is.com/7-korotkoe-porno.html]???????? ????? ?????[/url]
[url=http://night.npoln.is.com/yqh-pornovideo-studentov.html]?????????? ?????????[/url]
[url=http://440-look.npoln.is.com/jyg-polnyi-seks.html]?????? ????[/url]
[url=http://clear-clear.npoln.is.com/]????? ???? 40 ?????? – ?????? ????? ??????[/url]
[url=http://other-other.npoln.is.com/11-djenifer-lopes.html]???????? ????? ????? ?????[/url]
[url=http://959-ncrviw.npoln.is.com/4-tailandki-foto.html]????????? ???? ????[/url]
[url=http://small-645.npoln.is.com/zp-sexs-ru.html]Sexs Ru Video[/url]
[url=http://fnr-909.npoln.is.com/1-popki-devchenok.html]????? ????????[/url]
[url=http://take-208.npoln.is.com/]??????????????? ???????????? ???? – ?????? ????? ???????[/url]
[url=http://where-where.npoln.is.com/zo_biseksualnyi-seks.html]????????????? ????[/url]
[url=http://nice-nice.npoln.is.com/hg-seks-so-zrelymi.html]???? ?? ???????[/url]
[url=http://than-than.npoln.is.com/10-luchshee-porno-lesbiyanok.html]?????? ????? ?????????[/url]
[url=http://pje.npoln.is.com/10-chastnaya-erotika.html]??????? ??????? ?????[/url]
[url=http://himself-himself.npoln.is.com/4-d-seks.html]? ????[/url]
[url=http://750-lonely.npoln.is.com/6-seks-simy.html]???? ????[/url]
[url=http://they-49.npoln.is.com/8_cherno-beloe.html]????? ????? ????? ????[/url]
[url=http://burn-burn.npoln.is.com/1_seks-dosug.html]???? ????? ?????????[/url]
[url=http://227-take.npoln.is.com/9-porno-bolshie.html]????? ??????? ??????[/url]
[url=http://ttmh-place.npoln.is.com/1_seks-porno-video-klipy.html]???? ????? ????? ?????[/url]
[url=http://tcyb-472.npoln.is.com/1_pipiska-zhensciny.html]???????? ???????[/url]
[url=http://lzfvqm.npoln.is.com/gtv_free-femdom-video.html]Free Femdom Video[/url]
[url=http://lxlmlq-170.npoln.is.com/2_porno-kunnilingus.html]????? ???????????[/url]
[url=http://zqji-631.npoln.is.com/10-seks-festival-barselona.html]???? ????????? ?????????[/url]
[url=http://317-nqq.npoln.is.com/8_seks-analnyi-foto-mnogo.html]???? ???????? ???? ?????[/url]
[url=http://euo-165.npoln.is.com/ll-siski-5-razmera.html]?????? 5 ???????[/url]
[url=http://top-voqoqe.npoln.is.com/7-seks-lit.html]???? ???[/url]
[url=http://ever-ever.npoln.is.com/11_porno-nachalova.html]????? ????????[/url]
[url=http://finally-finally.npoln.is.com/nys_porno-video.html]????? ????? ????[/url]
[url=http://yolw-about.npoln.is.com/3_gruppovoi-seks.html]????????? ???? ?????[/url]
[url=http://272-skyqi.npoln.is.com/4_seks-syktyvkar.html]???? ?????????[/url]
[url=http://sound.npoln.is.com/cob-porno-pisma.html]????? ??????[/url]
[url=http://owhqm.npoln.is.com/4_ceks-saity.html]C??? ?????[/url]
[url=http://skachat.npoln.is.com/yen_kuban-seks.html]?????? ????[/url]
[url=http://114-fryl.npoln.is.com/dv-katalog-porno-saitov.html]??????? ????? ??????[/url]
[url=http://188-fear.npoln.is.com/]Animal Sex Ru – ????? ????? ??????[/url]
[url=http://daddy-tolvxy.npoln.is.com/3-seks-vidio.html]???? ?????[/url]
[url=http://sunny.npoln.is.com/11_kusok-pizdy.html]????? ?????[/url]
[url=http://win-lugxw.npoln.is.com/]???? 15 ?????? ????? – ??????? ????? ???????[/url]
???? ????? ????? ????
????? ???? ???????? ????
???????? ??????????? ????
??????????? ???? ?????????
???? ????? ????????
???? ????????? ?????
??????? ???????? ???????
porn stars com movies
?????? ?????
???? ??????? ????
????? ?????
????? ???
????? ?????
????? ??????? ????? ?????
sex znakomstva ru
January 8th, 2011 at 1:44 am
So, as I want to change lives and make this the easiest decision you have EVER made, you can get your very own copy of Forex Signal Shop for a PAYMENT OF ONLY $297 or FREE (see website for details) You need to act NOW and secure your spot in the Forex Signal Shop halls of fame. Lock in your access to Forex Signal Shop, so that you can be on your way to changing your life, just as I did.
Yes, I Want To Exploit [b]The[url=http://forexsignalshop.com] Forex Trading Signals[/url] Shop[/b] For [b]Huge Profits[/b] Too!
October 1st, 2011 at 1:16 pm
There are some fascinating time limits in this article however I don’t know if I see all of them middle to heart. There may be some validity however I will take maintain opinion till I look into it further. Good article , thanks and we would like more! Added to FeedBurner as nicely
October 10th, 2011 at 2:12 am
It¡¦s in reality a nice and useful piece of info. I¡¦m satisfied that you simply shared this useful info with us. Please keep us up to date like this. Thanks for sharing.
January 3rd, 2012 at 12:33 pm
nude photos of anna paquin