Commit graph

  • 9e78d62b13 Better handling of itemTypes, and improved date handling in PubMed scraper. Simon Kornblith 2006-06-25 05:03:01 +0000
  • f941bc192c Switched Info and Notes tab back to their places. :-) David Norton 2006-06-25 04:57:52 +0000
  • b2247e1dd2 Fixes #66, Need a function to get typeID given typeName Dan Stillman 2006-06-25 04:35:11 +0000
  • 22eebc6cdf Addresses #68, figure out way to have scrapers work for gated resources behind proxies. We can now access pages through an EZProxy. We need to know what alternatives to EZProxy exist in order to support them. Also, fixes some spacing issues in browser.js. Simon Kornblith 2006-06-25 04:30:43 +0000
  • b8ad832e74 Begin to work undo functionality into data layer -- currently just for Item.save() Dan Stillman 2006-06-25 04:11:19 +0000
  • f897564f0e Temporary fix to get ingested item types right until #66 is implemented Simon Kornblith 2006-06-24 21:44:36 +0000
  • 40fabb888c Addresses #65, back button fools ingester, and fixes bugs loading new tabs in the background. Simon Kornblith 2006-06-24 21:39:36 +0000
  • fd2052e63c Search results scraping for PubMed and Google Books. This marks the end of what I can do with respect to #15 until I'm at home or CHNM, where I'll have access to the gated collections. Simon Kornblith 2006-06-24 17:33:35 +0000
  • 260ce80086 - Search results scraping for TLC. This is the last of the library scrapers. - Minor fixes to ingester utilities. Simon Kornblith 2006-06-24 15:38:53 +0000
  • 06cf9e7853 Search results scraping for SIRSI (old versions) Simon Kornblith 2006-06-24 14:35:05 +0000
  • 97940c7470 Replaced all instances of "Firefox Scholar" (not counting the repository URL) with "Scholar for Firefox" for now Dan Stillman 2006-06-24 09:08:12 +0000
  • 720960feb9 Addresses #5, Add as many item types as possible Dan Stillman 2006-06-24 08:28:37 +0000
  • 22df47a0d3 A rough interface to add, remove and reorder item type fields -- at the moment just to make my life easier, but eventually could be adapted to allow end-user type/field editing, if we decide that's necessary Dan Stillman 2006-06-24 08:23:54 +0000
  • 42578ace59 Fixes #61, creator caching sometimes malfunctions Dan Stillman 2006-06-23 22:00:39 +0000
  • 6f19b215f5 Search result scraping for GEAC catalogs Simon Kornblith 2006-06-23 21:27:32 +0000
  • 2b58ead7aa Search results scraping for Dynix Simon Kornblith 2006-06-23 20:53:29 +0000
  • 2a74e88416 - Make generalized function for finding search results case insensitive - Scrape DRA search results Simon Kornblith 2006-06-23 20:09:48 +0000
  • 8fe72b3e3c Search results scraping for VTLS Simon Kornblith 2006-06-23 19:22:24 +0000
  • 641d7054cc - Fixed some bugs in the InnoPAC scraper (search results) - Made an Aleph search results scraper that works correctly on most sites, and degrades nicely when it doesn't Simon Kornblith 2006-06-23 17:35:57 +0000
  • 83c36f330d Scrapable search results for SIRSI 2003+ scraper Simon Kornblith 2006-06-23 16:17:53 +0000
  • 9742283389 InnoPAC scraper now handles search results pages Simon Kornblith 2006-06-23 14:12:34 +0000
  • 098078627c - Make events listening for DOMContentLoaded listen for load, because DOMContentLoaded does not seem ready for prime time (hey, it's undocumented, what can you expect) - Make Amazon scraper work with multiple documents - Fix bugs in processDocuments - Make Scholar.Ingester.Utilities.getItemArray() willing to take an array of DOM nodes to search for links, and finally take advantage of the fact that objects have no length Simon Kornblith 2006-06-23 03:02:30 +0000
  • b4d65420f3 ...but I forgot to update the timestamp Simon Kornblith 2006-06-22 20:51:40 +0000
  • 470f7c463f The Voyager scraper now actually works on the search results page. Simon Kornblith 2006-06-22 20:50:57 +0000
  • 3890e5f122 - Made ingester automatically create hidden browser objects, given a window object. This should make things much easier for both David and me. - Multiple item detection code is now a part of the scraperJavaScript, rather than the scrapeDetectCode, and code to choose which items to add is part of Scholar.Ingester.Utilities, accessible from inside scrapers. The alternative approach would result in one request (or, in the case of JSTOR, three requests) per new item, while in some cases (e.g. Voyager) only one request is necessary to get all of the items. Simon Kornblith 2006-06-22 15:50:46 +0000
  • 726364d091 Scholar.History -- i.e. undo/redo functionality Dan Stillman 2006-06-22 14:01:54 +0000
  • 1b74d0b04a Doh! Forgot to update scraper timestamp. Simon Kornblith 2006-06-22 02:46:30 +0000
  • ca3a0e6e5d Beginnings of search result scraping (does not yet actually do the scraping, but does present the menu) Simon Kornblith 2006-06-22 02:43:40 +0000
  • 428eab6a95 A cog menu each for collections and items (the same as the contextual menu, for now) Moved the capture icon into the URL bar (invisible until you visit a scrapable page. Currently just displays a Book, but will change to the correct item types in the future?) David Norton 2006-06-22 00:13:21 +0000
  • 718d613cdc Command-shift-S should now work as soon as you start Firefox. Lots of localization, moving style out of XUL and into overlay.css David Norton 2006-06-21 23:22:37 +0000
  • 27025befef Added "Disable automatic scraper updates" preference. (Up to Dan to implement this) David Norton 2006-06-21 22:31:52 +0000
  • 77b8bfd0b2 Added tabs: Tags, Files (nothing there yet) Added 'search options' toolbar on quick search (doesn't do anything yet) David Norton 2006-06-21 22:23:42 +0000
  • 9a9621f39d Make net appear even before first page has loaded Simon Kornblith 2006-06-21 18:19:49 +0000
  • 6b2d9bb3e6 Don't break the extension right before we show it Dan Stillman 2006-06-21 16:06:41 +0000
  • 336f92a832 Set repository check timer to 1 hour during development Dan Stillman 2006-06-21 16:04:45 +0000
  • 6d1e447154 - Remove load eventListener after it has been called once - Capture editors from Google Books Simon Kornblith 2006-06-21 15:18:18 +0000
  • 90ff41cb40 Added contributors, developers to install.rdf (in alphabetical order, last name) David Norton 2006-06-21 14:42:29 +0000
  • f753c1cc2f Add Google Books scraper Simon Kornblith 2006-06-21 14:28:51 +0000
  • 7b08c94437 Remember to update modified dates on changed scrapers. Simon Kornblith 2006-06-21 13:55:55 +0000
  • 7d3deb5b9f - Make Scholar.Ingester.Utilities.loadDocument() attach an event handler to load rather than DOMContentLoaded to resolve an issue with the Ex Libris/Aleph scraper (VCU) - When possible, corporate creators/contributors are categorized with their own RDF types (prefixDummy + "corporateCreator/corporateContributor) - Remove extraneous debug code in extensions Simon Kornblith 2006-06-21 01:41:07 +0000
  • 6c89acbe0d Scholar.inArray(needle, haystack) and Scholar.arraySearch(needle, haystack) -- versions of the PHP functions for JS Dan Stillman 2006-06-20 17:32:40 +0000
  • 6b002f7566 Got some new icons for the lists Toolbar buttons are now icons David Norton 2006-06-20 17:08:30 +0000
  • 09d79d6dd7 Fix overly optimistic JSTOR scraper Simon Kornblith 2006-06-20 17:06:41 +0000
  • 968348a5d1 Add a scraper for Dublin Core metadata embedded in HTML/XHTML META tags Simon Kornblith 2006-06-20 16:08:13 +0000
  • a3df0c39e2 - DB parameters can now be bound using the native JS type rather than by specifying the type explicitly (e.g. Scholar.DB.query(sql, [1, 2, "hello"]) -- for use when the data is generated internally and trusted, obviously Dan Stillman 2006-06-20 15:42:01 +0000
  • d239e6e4ba Typo in trigger() call in Collection.addItem() (thanks David) Dan Stillman 2006-06-20 15:28:20 +0000
  • 95ca76545f QA testing of extension performance aboard trains Dan Stillman 2006-06-20 15:23:44 +0000
  • 8f38c09c2e Ignore case on sorting. David Norton 2006-06-20 14:36:49 +0000
  • 5af10b1061 - Fix small bug in ingester interface Simon Kornblith 2006-06-20 14:16:15 +0000
  • 9f1cbf3177 Added back the Add menu with itemTypes. Minor text changes David Norton 2006-06-20 13:59:59 +0000
  • c983a8e7e4 - Re-named Scholar.Ingester.Interface to Scholar_Ingester_Interface (since Scholar object is defined in XPCOM and thus global) Simon Kornblith 2006-06-20 00:52:15 +0000
  • d87f68e8e8 Double click an item to un-collapse the item pane. The item pane remembers whether or not it was collapsed. David Norton 2006-06-19 18:43:21 +0000
  • 8d50874d6b [interface] You can now change an item's type via menu. David Norton 2006-06-19 15:45:32 +0000
  • c345b90b9a Contextual menus - Collections, Items. Moved close button to a more sensible place. On Item Add: Clear search text, and select Info tab. Minor function renames. David Norton 2006-06-19 15:00:13 +0000
  • 4c34c592da - Better handling of InnoPAC records not returned by searches Simon Kornblith 2006-06-18 21:00:43 +0000
  • 20369f41b3 - Move commonly used scraper functions to ingester.js, rather than re-defining them in each scraper. This breaks Piggy Bank compatibility in our scrapers, but we will still be able to export our scrapers in a Piggy Bank compatible form. - Better handling of scraper RDF to item mapping. - Improved date handling. All scrapers now return ISO-style dates when possible. Simon Kornblith 2006-06-18 19:04:32 +0000
  • 3d881eec13 - Make scrapers return standard ISO-style YYYY-MM-DD dates. Still need to work on journal article scrapers. - Ingester lets callback function save items, rather than saving them itself. - Better handling of multiple items in API, although no scrapers currently implement this. Simon Kornblith 2006-06-17 21:21:15 +0000
  • 953b1f9d20 Lots of little things: - Fix item modify notify() on 1st row. - Ensure that new items are visible when added. - New functionality for creating new items (prevents a lot of problems). - Number-based fields display properly. - Fixed bug when creating and saving the first notes on an item. - New notes won't save empty. David Norton 2006-06-17 00:57:50 +0000
  • 32ce0da44a Restore the statement.reset() in valueQuery() that I accidentally deleted in r216 Dan Stillman 2006-06-16 22:17:46 +0000
  • bfa25cae37 Display SQLite error in exceptions thrown from commitTransaction() and rollbackTransaction() (like the ones on field value updates that I'm trying to figure out at the moment) Dan Stillman 2006-06-16 22:15:07 +0000
  • e8ed4281f9 Change the DB query functions to return values of the actual types they are, rather than to return everything as strings -- this will prevent the need for parseInt on COUNT(*) values, etc. and is generally better Dan Stillman 2006-06-16 21:44:41 +0000
  • 936ef86584 Fix Item.numNotes() and Item.getNotes() to work on items not yet in the DB (return 0 and [], respectively) Dan Stillman 2006-06-16 21:33:03 +0000
  • bf0626cb58 [interface] All editing elements that look like labels but provide functionality now offer hover feedback [fix] You shouldn't lose your changes if you select another item in the middle of editing a field. [fix] The dropdown menu to select notes doesn't steal the focus David Norton 2006-06-16 17:21:30 +0000
  • 380584986a [fix] If you do a sort, modify a note, etc. it does not reload the selected item [interface/fix] There will always be a secondary sort on date modified. (fixes the infamous Turkle Toggle issue once and for all) David Norton 2006-06-16 16:30:03 +0000
  • 4904c04e3e Add dateCreated and dateModified columns to itemNotes Dan Stillman 2006-06-16 16:09:18 +0000
  • 3f27a12b0f Trigger notify('modify', 'item', noteID) on note modify Dan Stillman 2006-06-16 15:57:52 +0000
  • 942c6d5da2 [interface] Number of notes column in items tree David Norton 2006-06-16 15:27:22 +0000
  • 08a570a38a Item.numNotes() Dan Stillman 2006-06-16 15:18:01 +0000
  • 3cdcf3093a [interface] Confirms delete of note [fix] Minor fix - no more exception on ItemTreeView when you hit the left or right arrow [ignore] simplified some checking in the note code. David Norton 2006-06-16 15:15:42 +0000
  • 8ff6c48001 [interface] Custom textbox binding: multiline and timed together. [interface] Multiple notes: works like a charm David Norton 2006-06-16 14:39:18 +0000
  • 47d59f2dc1 Add note contents to search Dan Stillman 2006-06-16 08:04:01 +0000
  • 7ef16e0a38 Reverted sample data to remove notes field (independent notes will need a field for that but we'll deal with that later) Dan Stillman 2006-06-16 07:56:24 +0000
  • 7a8ddb1beb Fix logic in _noteToTitle in itemPane.js (if no newline in note the title would be "Untitled Note") -- though it'd be better to do what Stickies do and just find the first bit of text, even if it's not on the first line (regex is probably easiest) Dan Stillman 2006-06-16 07:44:55 +0000
  • fd85af40f8 Many-to-one item note support in the schema and data layer -- still some issues on (I think) the interface side Dan Stillman 2006-06-16 07:32:48 +0000
  • e417d8e690 [interface] Although commented out, code in place to accept URL drags into collections (waiting on an Ingester.scrapeURL function) [interface] Multi-notes functionality (waiting on data layer) [docs] Major internal documentation written for itemTreeView.js and collectionTreeView.js (this actually does work ;-)) David Norton 2006-06-15 22:35:48 +0000
  • f635ee7788 Make the retry interval 60 minutes, not 60 seconds Dan Stillman 2006-06-15 21:24:04 +0000
  • 8e97675cc9 Added a timer to run repository checks while the browser is up Dan Stillman 2006-06-15 21:06:24 +0000
  • 2d20fe717d Added Scholar.HTTP.browserIsOffline() and changed doGet() and doPost() to return false if so Dan Stillman 2006-06-15 16:52:46 +0000
  • 11a056ecd4 _getDBVersion() caches the version number, so make sure _updateDBVersion() updates it Dan Stillman 2006-06-15 16:28:11 +0000
  • 70216ea2c7 - Added automatic scraper update mechanism (more details on Basecamp: http://chnm.grouphub.com/C2687015) Dan Stillman 2006-06-15 06:13:02 +0000
  • 70be7cf8fd Switched Notes and Info tabs. The tabbox should always fill the allotted space. Hopefully? David Norton 2006-06-14 17:43:02 +0000
  • 8ed37732c1 JS Date() takes months 0-11, for reasons that are far from clear Dan Stillman 2006-06-14 16:59:29 +0000
  • 2399f044e1 [Drag and Drop] in the Collections Tree: Now checks to make sure that the correct type is being dragged, and that you aren't dropping a folder into subfolders, etc. [Drag and Drop] in Items Tree: You can drag items from one window into another, directly into the Items list. [Editing] Close the edit box and save when you click on its label David Norton 2006-06-14 15:51:05 +0000
  • c8a74e96cd Don't be dumb Dan Stillman 2006-06-14 15:41:25 +0000
  • 3e11379c3a Notes now automatically save - no "save" button. The collections list does not resize randomly now. The pane on the right stays open all the time - even when 0/multiple items are selected. This is to avoid frequent resizing of the items pane. Temporarily, if the first "word" of a field's value is more than 29 characters long, it will set it to crop. This is for the long URLs, etc. David Norton 2006-06-13 20:45:30 +0000
  • ba16889bb0 Moved the Scholar.Hash constructor out of the main Scholar constructor, where I had put it for some reason -- ignore Dan Stillman 2006-06-13 15:14:22 +0000
  • ca2045a305 Scholar.Date.sqlToDate(string sqldate) -- function to convert SQL-formatted date (e.g. '2006-06-13 11:03:05' or '2006-06-13') into a JS date object Dan Stillman 2006-06-13 15:07:08 +0000
  • 39f9d2c3b3 Wrapper functions for XMLHTTPRequest in scholar.js, stolen and adapted slightly from Simon's ingester code (those override the mime type to text/plain and only use responseText, I assume to conform to the Piggy Bank API, so unfortunately we can't use the same ones elsewhere) Dan Stillman 2006-06-13 14:53:38 +0000
  • d42258b168 Changed schema of scrapers table to use single GUID for scraperID Dan Stillman 2006-06-12 15:43:24 +0000
  • 37c0a61393 [style] collection icons have padding David Norton 2006-06-12 13:56:36 +0000
  • 0b1765b549 Move CreatorTypes constructor in code -- ignore Dan Stillman 2006-06-12 13:08:36 +0000
  • c24c148e0b Cache creator type names to prevent repeated DB lookups in CreatorTypes.getTypeName() Dan Stillman 2006-06-12 13:05:30 +0000
  • 5a045f5b50 Cache item type names to prevent repeated DB lookups in ItemTypes.getTypeName() Dan Stillman 2006-06-12 12:59:25 +0000
  • b1389bfc61 [interface] Item Type column (will show up on the right if you already have Scholar installed, but on the left for all new installations.), sortable. [style] Better add/remove Creator buttons. [fix] The sorting should not randomly switch the order of two items with the same sort value (eg, Barnes vs. Barnes). [fix] The browser should not open with two sorted columns. David Norton 2006-06-12 12:43:20 +0000
  • cebd6bde5b [interface] Images now appear on the collections tree and items tree. (yes, they are ugly). David Norton 2006-06-09 16:36:18 +0000
  • 68fed95e8f Renamed metadataPane.js/xul to match previous change. David Norton 2006-06-09 15:54:44 +0000
  • a7b35c0286 [interface] Preliminary note editing support. [other] MetadataPane renamed ScholarItemPane. David Norton 2006-06-09 15:52:40 +0000
  • fbcd247b09 Cleaned up the code in the tree views. Fixed a bug on 'add' - items showing up in Library even if they were already there. David Norton 2006-06-09 14:42:53 +0000
  • 9f7437f5ca [interface] itemsTreeView correctly handles notify(erase) [data access] Collection.removeItem() calls trigger() with the right type David Norton 2006-06-09 14:01:07 +0000
  • 14ba1b8fbc [interface] collection stays selected on drag-and-drop. [interface] Collections notify() cleaned up a bit. David Norton 2006-06-08 21:47:33 +0000