Commit graph

433 commits

Author SHA1 Message Date
Samuel Clay
44f89023ff Placing upper limits on dates 2009-12-18 20:49:38 +00:00
Samuel Clay
8bf5fc8dca Fixing the out-of-date dupe bug. 2009-12-18 20:47:44 +00:00
Samuel Clay
f518e10ea1 Ignoring logs 2009-12-18 18:31:04 +00:00
Samuel Clay
b216ebf48a Adding a tokenizer to the classifier, as well as using Divmod's Reverend Bayesian classifier. 2009-12-18 18:29:34 +00:00
Samuel Clay
06e94610dc Adding Phrase Filter to Analyzer. Just need to hook up the phrase filter to the story classifier and then save the results to be used for later processing. 2009-11-15 18:57:53 +00:00
Samuel Clay
d2c71e12f8 Moving the logo down 2009-11-15 18:49:37 +00:00
Samuel Clay
bc47a70058 Fixed numerous issues with story finding on frame page. And refactored switcheroo functions. 2009-11-08 03:26:54 +00:00
Samuel Clay
5fa009113c Moving around the like/dislike buttons to a per-story basis in the story-titles section of the page. 2009-11-03 20:25:40 +00:00
Samuel Clay
fb6d0692ce Naive Fisher Bayesian Classifier. Stubbed in some boilerplate for making the analyzer do its job. Still have to connect it to feeds and train on real data, but it's looking good as a starting point. 2009-11-03 03:52:03 +00:00
Samuel Clay
0edbb7ed74 I just don't feel comfortable with Django's thread-unsafe ORM. Putting locks back in place around all database .save() calls. It's The Right Thing To Do. 2009-09-16 04:00:37 +00:00
Samuel Clay
19df861456 Forgot to remove tests. 2009-09-16 03:56:58 +00:00
Samuel Clay
7b08770b3a Getting rid of Queues entirely. Replaced with values being distributed directly to Processes. One day this will change. Until then, all feeds fit in memory. 2009-09-16 03:54:33 +00:00
Samuel Clay
e06b736c5b Split the db connection between multiple Processes. To do this, you must close the db connection at the Process creation, so the process can re-create its own connection. 2009-09-16 02:39:45 +00:00
Samuel Clay
4aa0271047 Adding semaphore locks on all mysql db requests in threads/processes. 2009-09-16 02:34:04 +00:00
Samuel Clay
a7888c2aae Switching from threads to processes. Sure, no big deal. Django is not thread-safe, so I can't use threads. I can, however, use multiprocessing to pass a Queue around between Processes. 2009-09-16 02:22:27 +00:00
Samuel Clay
0446ff2ee3 Adding locks to feed processing. 2009-09-12 20:42:38 +00:00
Samuel Clay
9026bc4401 Maybe exiting the thread will work... 2009-09-12 20:15:22 +00:00
Samuel Clay
bec2f00979 Exiting after it's over. 2009-09-10 04:24:51 +00:00
Samuel Clay
0b9b778382 Queues not working. Reverting back to 1 feed at a time. Ugh. 2009-09-10 04:16:50 +00:00
Samuel Clay
8437ef29f1 Handling empty queues and increasing thread count 2009-09-10 03:52:43 +00:00
Samuel Clay
67ab0d6c66 Let's try changing the load. 2009-09-10 03:48:22 +00:00
Samuel Clay
02a4d292e8 Moving from threadpool to a Queue. Much simpler. 2009-09-10 03:33:05 +00:00
Samuel Clay
0caf49e9a4 OK. Turning on threading for feed fetching. Enough logging to catch the bugs. Fixed the segmentation fault on exit. 2009-09-10 02:31:55 +00:00
Samuel Clay
dd95ef5a37 Ignoring generated media 2009-09-09 19:20:02 +00:00
Samuel Clay
5185da7b16 Mark All as Read fixed. 2009-09-08 04:37:38 +00:00
Samuel Clay
4f41567628 Stories can now be marked as read. Small bug. 2009-09-08 04:27:27 +00:00
Samuel Clay
43e78dd229 Using JSMin instead of YUICompressor. YUI needs java, and why bother for 1% difference. 2009-09-08 03:49:10 +00:00
Samuel Clay
8220f273cf Using new release/ folder. 2009-09-08 03:43:34 +00:00
Samuel Clay
65c2021e41 Adding release/ folder 2009-09-08 03:42:54 +00:00
Samuel Clay
652b921b20 Settings for django-compress 2009-09-08 03:39:46 +00:00
Samuel Clay
2a0654ea4a updating djangocompress 2009-09-08 03:37:17 +00:00
Samuel Clay
f9a0087334 Adding django-compress. 2009-09-08 03:15:49 +00:00
Samuel Clay
7eb48ef182 Favicon 2009-09-08 01:47:43 +00:00
Samuel Clay
0fd9d0fbdb Making those "pages" of stories actually work correctly. 2009-09-08 01:26:13 +00:00
Samuel Clay
853d653dd8 Paging in the story titles pane. Now with indicator status and feed view updating. 2009-09-08 01:06:48 +00:00
Samuel Clay
2ac39549ae The "Hacker News" bug is fixed. Weirdo HN site doesn't publish guids or timestamps. Now bubbling priorities on ids. Also added 'j' and 'k' keyboard shortcuts. And fixed the escaping url bug on the Reader. 2009-09-08 00:13:49 +00:00
Samuel Clay
841b432c51 - Added logic to story search on page to strip tags and parentheticals from story content when the title can not be found and the content is used as a last resort.
- Added logic to make sure that the found elements are also visible. (No use in finding hidden elements).
2009-09-07 16:49:46 +00:00
Samuel Clay
2c286d23c1 Beautiful scrolling behavior for the story titles themselves. Mimics an OS properly. 2009-09-07 04:32:42 +00:00
Samuel Clay
899af117a6 Fixing a metric-ton of issues around feed-to-page transformations when a story is either found or not found. 2009-09-07 03:20:50 +00:00
Samuel Clay
c0ca9277b8 - Added specialized unit tests for crappy RSS input (like Slashdot).
- Rewrote the feed view in the reader. It is now a long list and looks a lot better.
- Big update to story title logic. Can now handle many more edge cases. Also uses smarter heading finder.
- Fixed scrollTo bug, so now multiple clicks do not queue awkwardly.
- Moved the story titles pane to the bottom.
2009-09-07 01:56:52 +00:00
Samuel Clay
27e539ba57 What happens if the id/permalink are blank? Same story! No, bad idea. 2009-09-05 02:37:31 +00:00
Samuel Clay
acd464af86 Using story GUID's on top of permalinks. 2009-09-05 02:22:25 +00:00
Samuel Clay
fbe5c19ab5 Fixed bug: If in "switched" view, changing feed should take you out of switched view and into the page view. 2009-09-01 12:43:45 +00:00
Samuel Clay
105b0e7647 Auto-switch to feed view when story not found on page. Auto-switch back if the user does not explicitly switch to feed view. Smart thinking! 2009-09-01 12:38:47 +00:00
Samuel Clay
090ba9fb23 Fixing the story->page animation (story finding). Much more refined in its story-finding algorithm. Works like a charm everywhere, so far, bringing my out-of-the-ass calculation to 98% correct. 2009-08-30 02:06:54 +00:00
Samuel Clay
615d1fb530 Whoops - scores should be set to *something* 2009-08-30 00:47:56 +00:00
Samuel Clay
9e522ca528 Woo - Checking for content and title differences to resolve duplicate entries. Integration tests prove a number of differences are successfully resolved. 2009-08-30 00:43:13 +00:00
Samuel Clay
bdd91d714d Refactored the feed fetcher. Added integration tests for dupe matching. Also stubbed in AI score calculations so I can do something with the output soon. 2009-08-29 19:34:42 +00:00
Samuel Clay
3bd43a8cb4 Updating algorithm to insert the necessary base information into the feed's page. 2009-08-26 03:12:55 +00:00
Samuel Clay
d24b56fbf4 Adding new "Return to Page" button. When the user visits other pages in a feed, security prevents NB from reading the iframe, so we provide a convenient hook to bring the iframe back. Call it SnapBack, except, don't. 2009-08-26 02:31:35 +00:00