Simon Kornblith
22eebc6cdf
Addresses #68 , figure out way to have scrapers work for gated resources behind proxies. We can now access pages through an EZProxy. We need to know what alternatives to EZProxy exist in order to support them. Also, fixes some spacing issues in browser.js.
2006-06-25 04:30:43 +00:00
Dan Stillman
b8ad832e74
Begin to work undo functionality into data layer -- currently just for Item.save()
...
History.undo()/redo() now reload the item, though changes won't show in open metadata pane due to #71
refs #67
2006-06-25 04:11:19 +00:00
Simon Kornblith
f897564f0e
Temporary fix to get ingested item types right until #66 is implemented
2006-06-24 21:44:36 +00:00
Simon Kornblith
40fabb888c
Addresses #65 , back button fools ingester, and fixes bugs loading new tabs in the background.
2006-06-24 21:39:36 +00:00
Simon Kornblith
fd2052e63c
Search results scraping for PubMed and Google Books. This marks the end of what I can do with respect to #15 until I'm at home or CHNM, where I'll have access to the gated collections.
2006-06-24 17:33:35 +00:00
Simon Kornblith
260ce80086
- Search results scraping for TLC. This is the last of the library scrapers.
...
- Minor fixes to ingester utilities.
2006-06-24 15:38:53 +00:00
Simon Kornblith
06cf9e7853
Search results scraping for SIRSI (old versions)
2006-06-24 14:35:05 +00:00
Dan Stillman
97940c7470
Replaced all instances of "Firefox Scholar" (not counting the repository URL) with "Scholar for Firefox" for now
2006-06-24 09:08:12 +00:00
Dan Stillman
720960feb9
Addresses #5 , Add as many item types as possible
...
New item types from Elena
2006-06-24 08:28:37 +00:00
Dan Stillman
22df47a0d3
A rough interface to add, remove and reorder item type fields -- at the moment just to make my life easier, but eventually could be adapted to allow end-user type/field editing, if we decide that's necessary
2006-06-24 08:23:54 +00:00
Dan Stillman
42578ace59
Fixes #61 , creator caching sometimes malfunctions
2006-06-23 22:00:39 +00:00
Simon Kornblith
6f19b215f5
Search result scraping for GEAC catalogs
2006-06-23 21:27:32 +00:00
Simon Kornblith
2b58ead7aa
Search results scraping for Dynix
2006-06-23 20:53:29 +00:00
Simon Kornblith
2a74e88416
- Make generalized function for finding search results case insensitive
...
- Scrape DRA search results
2006-06-23 20:09:48 +00:00
Simon Kornblith
8fe72b3e3c
Search results scraping for VTLS
2006-06-23 19:22:24 +00:00
Simon Kornblith
641d7054cc
- Fixed some bugs in the InnoPAC scraper (search results)
...
- Made an Aleph search results scraper that works correctly on most sites, and degrades nicely when it doesn't
2006-06-23 17:35:57 +00:00
Simon Kornblith
83c36f330d
Scrapable search results for SIRSI 2003+ scraper
2006-06-23 16:17:53 +00:00
Simon Kornblith
9742283389
InnoPAC scraper now handles search results pages
2006-06-23 14:12:34 +00:00
Simon Kornblith
098078627c
- Make events listening for DOMContentLoaded listen for load, because DOMContentLoaded does not seem ready for prime time (hey, it's undocumented, what can you expect)
...
- Make Amazon scraper work with multiple documents
- Fix bugs in processDocuments
- Make Scholar.Ingester.Utilities.getItemArray() willing to take an array of DOM nodes to search for links, and finally take advantage of the fact that objects have no length
2006-06-23 03:02:30 +00:00
Simon Kornblith
b4d65420f3
...but I forgot to update the timestamp
2006-06-22 20:51:40 +00:00
Simon Kornblith
470f7c463f
The Voyager scraper now actually works on the search results page.
2006-06-22 20:50:57 +00:00
Simon Kornblith
3890e5f122
- Made ingester automatically create hidden browser objects, given a window object. This should make things much easier for both David and me.
...
- Multiple item detection code is now a part of the scraperJavaScript, rather than the scrapeDetectCode, and code to choose which items to add is part of Scholar.Ingester.Utilities, accessible from inside scrapers. The alternative approach would result in one request (or, in the case of JSTOR, three requests) per new item, while in some cases (e.g. Voyager) only one request is necessary to get all of the items.
2006-06-22 15:50:46 +00:00
Dan Stillman
726364d091
Scholar.History -- i.e. undo/redo functionality
...
Partially integrated into data layer, but I'm waiting to commit that part until I'm sure it won't break everything
2006-06-22 14:01:54 +00:00
Simon Kornblith
1b74d0b04a
Doh! Forgot to update scraper timestamp.
2006-06-22 02:46:30 +00:00
Simon Kornblith
ca3a0e6e5d
Beginnings of search result scraping (does not yet actually do the scraping, but does present the menu)
2006-06-22 02:43:40 +00:00
David Norton
428eab6a95
A cog menu each for collections and items (the same as the contextual menu, for now)
...
Moved the capture icon into the URL bar (invisible until you visit a scrapable page. Currently just displays a Book, but will change to the correct item types in the future?)
2006-06-22 00:13:21 +00:00
David Norton
718d613cdc
Command-shift-S should now work as soon as you start Firefox.
...
Lots of localization, moving style out of XUL and into overlay.css
2006-06-21 23:22:37 +00:00
David Norton
27025befef
Added "Disable automatic scraper updates" preference. (Up to Dan to implement this)
2006-06-21 22:31:52 +00:00
David Norton
77b8bfd0b2
Added tabs: Tags, Files (nothing there yet)
...
Added 'search options' toolbar on quick search (doesn't do anything yet)
2006-06-21 22:23:42 +00:00
Simon Kornblith
9a9621f39d
Make net appear even before first page has loaded
2006-06-21 18:19:49 +00:00
Dan Stillman
6b2d9bb3e6
Don't break the extension right before we show it
2006-06-21 16:06:41 +00:00
Dan Stillman
336f92a832
Set repository check timer to 1 hour during development
2006-06-21 16:04:45 +00:00
Simon Kornblith
6d1e447154
- Remove load eventListener after it has been called once
...
- Capture editors from Google Books
2006-06-21 15:18:18 +00:00
David Norton
90ff41cb40
Added contributors, developers to install.rdf (in alphabetical order, last name)
2006-06-21 14:42:29 +00:00
Simon Kornblith
f753c1cc2f
Add Google Books scraper
2006-06-21 14:28:51 +00:00
Simon Kornblith
7b08c94437
Remember to update modified dates on changed scrapers.
2006-06-21 13:55:55 +00:00
Simon Kornblith
7d3deb5b9f
- Make Scholar.Ingester.Utilities.loadDocument() attach an event handler to load rather than DOMContentLoaded to resolve an issue with the Ex Libris/Aleph scraper (VCU)
...
- When possible, corporate creators/contributors are categorized with their own RDF types (prefixDummy + "corporateCreator/corporateContributor)
- Remove extraneous debug code in extensions
2006-06-21 01:41:07 +00:00
Dan Stillman
6c89acbe0d
Scholar.inArray(needle, haystack) and Scholar.arraySearch(needle, haystack) -- versions of the PHP functions for JS
2006-06-20 17:32:40 +00:00
David Norton
6b002f7566
Got some new icons for the lists
...
Toolbar buttons are now icons
2006-06-20 17:08:30 +00:00
Simon Kornblith
09d79d6dd7
Fix overly optimistic JSTOR scraper
2006-06-20 17:06:41 +00:00
Simon Kornblith
968348a5d1
Add a scraper for Dublin Core metadata embedded in HTML/XHTML META tags
2006-06-20 16:08:13 +00:00
Dan Stillman
a3df0c39e2
- DB parameters can now be bound using the native JS type rather than by specifying the type explicitly (e.g. Scholar.DB.query(sql, [1, 2, "hello"]) -- for use when the data is generated internally and trusted, obviously
...
- Don't try to display an SQLite error when it's "not an error" (i.e. when the error is in something else)
- Switch to nsIFile instead of nsILocalFile to retrieve the profile directory
2006-06-20 15:42:01 +00:00
Dan Stillman
d239e6e4ba
Typo in trigger() call in Collection.addItem() (thanks David)
2006-06-20 15:28:20 +00:00
Dan Stillman
95ca76545f
QA testing of extension performance aboard trains
...
Fix in Collection.erase() -- when the DB methods started returning values in their native type, the collection id became an int rather than a string and "new Array(this._id)" became a length declaration rather than an elements declaration
2006-06-20 15:23:44 +00:00
David Norton
8f38c09c2e
Ignore case on sorting.
2006-06-20 14:36:49 +00:00
Simon Kornblith
5af10b1061
- Fix small bug in ingester interface
2006-06-20 14:16:15 +00:00
David Norton
9f1cbf3177
Added back the Add menu with itemTypes.
...
Minor text changes
2006-06-20 13:59:59 +00:00
Simon Kornblith
c983a8e7e4
- Re-named Scholar.Ingester.Interface to Scholar_Ingester_Interface (since Scholar object is defined in XPCOM and thus global)
2006-06-20 00:52:15 +00:00
David Norton
d87f68e8e8
Double click an item to un-collapse the item pane.
...
The item pane remembers whether or not it was collapsed.
2006-06-19 18:43:21 +00:00
David Norton
8d50874d6b
[interface] You can now change an item's type via menu.
2006-06-19 15:45:32 +00:00