Samuel Clay
44f89023ff
Placing upper limits on dates
2009-12-18 20:49:38 +00:00
Samuel Clay
8bf5fc8dca
Fixing the out-of-date dupe bug.
2009-12-18 20:47:44 +00:00
Samuel Clay
f518e10ea1
Ignoring logs
2009-12-18 18:31:04 +00:00
Samuel Clay
b216ebf48a
Adding a tokenizer to the classifier, as well as using Divmod's Reverend Bayesian classifier.
2009-12-18 18:29:34 +00:00
Samuel Clay
06e94610dc
Adding Phrase Filter to Analyzer. Just need to hook up the phrase filter to the story classifier and then save the results to be used for later processing.
2009-11-15 18:57:53 +00:00
Samuel Clay
d2c71e12f8
Moving the logo down
2009-11-15 18:49:37 +00:00
Samuel Clay
bc47a70058
Fixed numerous issues with story finding on frame page. And refactored switcheroo functions.
2009-11-08 03:26:54 +00:00
Samuel Clay
5fa009113c
Moving around the like/dislike buttons to a per-story basis in the story-titles section of the page.
2009-11-03 20:25:40 +00:00
Samuel Clay
fb6d0692ce
Naive Fisher Bayesian Classifier. Stubbed in some boilerplate for making the analyzer do its job. Still have to connect it to feeds and train on real data, but it's looking good as a starting point.
2009-11-03 03:52:03 +00:00
Samuel Clay
0edbb7ed74
I just don't feel comfortable with Django's thread-unsafe ORM. Putting locks back in place around all database .save() calls. It's The Right Thing To Do.
2009-09-16 04:00:37 +00:00
Samuel Clay
19df861456
Forgot to remove tests.
2009-09-16 03:56:58 +00:00
Samuel Clay
7b08770b3a
Getting rid of Queues entirely. Replaced with values being distributed directly to Processes. One day this will change. Until then, all feeds fit in memory.
2009-09-16 03:54:33 +00:00
Samuel Clay
e06b736c5b
Split the db connection between multiple Processes. To do this, you must close the db connection at the Process creation, so the process can re-create its own connection.
2009-09-16 02:39:45 +00:00
Samuel Clay
4aa0271047
Adding semaphore locks on all mysql db requests in threads/processes.
2009-09-16 02:34:04 +00:00
Samuel Clay
a7888c2aae
Switching from threads to processes. Sure, no big deal. Django is not thread-safe, so I can't use threads. I can, however, use multiprocessing to pass a Queue around between Processes.
2009-09-16 02:22:27 +00:00
Samuel Clay
0446ff2ee3
Adding locks to feed processing.
2009-09-12 20:42:38 +00:00
Samuel Clay
9026bc4401
Maybe exiting the thread will work...
2009-09-12 20:15:22 +00:00
Samuel Clay
bec2f00979
Exiting after it's over.
2009-09-10 04:24:51 +00:00
Samuel Clay
0b9b778382
Queues not working. Reverting back to 1 feed at a time. Ugh.
2009-09-10 04:16:50 +00:00
Samuel Clay
8437ef29f1
Handling empty queues and increasing thread count
2009-09-10 03:52:43 +00:00
Samuel Clay
67ab0d6c66
Let's try changing the load.
2009-09-10 03:48:22 +00:00
Samuel Clay
02a4d292e8
Moving from threadpool to a Queue. Much simpler.
2009-09-10 03:33:05 +00:00
Samuel Clay
0caf49e9a4
OK. Turning on threading for feed fetching. Enough logging to catch the bugs. Fixed the segmentation fault on exit.
2009-09-10 02:31:55 +00:00
Samuel Clay
dd95ef5a37
Ignoring generated media
2009-09-09 19:20:02 +00:00
Samuel Clay
5185da7b16
Mark All as Read fixed.
2009-09-08 04:37:38 +00:00
Samuel Clay
4f41567628
Stories can now be marked as read. Small bug.
2009-09-08 04:27:27 +00:00
Samuel Clay
43e78dd229
Using JSMin instead of YUICompressor. YUI needs java, and why bother for 1% difference.
2009-09-08 03:49:10 +00:00
Samuel Clay
8220f273cf
Using new release/ folder.
2009-09-08 03:43:34 +00:00
Samuel Clay
65c2021e41
Adding release/ folder
2009-09-08 03:42:54 +00:00
Samuel Clay
652b921b20
Settings for django-compress
2009-09-08 03:39:46 +00:00
Samuel Clay
2a0654ea4a
updating djangocompress
2009-09-08 03:37:17 +00:00
Samuel Clay
f9a0087334
Adding django-compress.
2009-09-08 03:15:49 +00:00
Samuel Clay
7eb48ef182
Favicon
2009-09-08 01:47:43 +00:00
Samuel Clay
0fd9d0fbdb
Making those "pages" of stories actually work correctly.
2009-09-08 01:26:13 +00:00
Samuel Clay
853d653dd8
Paging in the story titles pane. Now with indicator status and feed view updating.
2009-09-08 01:06:48 +00:00
Samuel Clay
2ac39549ae
The "Hacker News" bug is fixed. Weirdo HN site doesn't publish guids or timestamps. Now bubbling priorities on ids. Also added 'j' and 'k' keyboard shortcuts. And fixed the escaping url bug on the Reader.
2009-09-08 00:13:49 +00:00
Samuel Clay
841b432c51
- Added logic to story search on page to strip tags and parentheticals from story content when the title can not be found and the content is used as a last resort.
...
- Added logic to make sure that the found elements are also visible. (No use in finding hidden elements).
2009-09-07 16:49:46 +00:00
Samuel Clay
2c286d23c1
Beautiful scrolling behavior for the story titles themselves. Mimics an OS properly.
2009-09-07 04:32:42 +00:00
Samuel Clay
899af117a6
Fixing a metric-ton of issues around feed-to-page transformations when a story is either found or not found.
2009-09-07 03:20:50 +00:00
Samuel Clay
c0ca9277b8
- Added specialized unit tests for crappy RSS input (like Slashdot).
...
- Rewrote the feed view in the reader. It is now a long list and looks a lot better.
- Big update to story title logic. Can now handle many more edge cases. Also uses smarter heading finder.
- Fixed scrollTo bug, so now multiple clicks do not queue awkwardly.
- Moved the story titles pane to the bottom.
2009-09-07 01:56:52 +00:00
Samuel Clay
27e539ba57
What happens if the id/permalink are blank? Same story! No, bad idea.
2009-09-05 02:37:31 +00:00
Samuel Clay
acd464af86
Using story GUID's on top of permalinks.
2009-09-05 02:22:25 +00:00
Samuel Clay
fbe5c19ab5
Fixed bug: If in "switched" view, changing feed should take you out of switched view and into the page view.
2009-09-01 12:43:45 +00:00
Samuel Clay
105b0e7647
Auto-switch to feed view when story not found on page. Auto-switch back if the user does not explicitly switch to feed view. Smart thinking!
2009-09-01 12:38:47 +00:00
Samuel Clay
090ba9fb23
Fixing the story->page animation (story finding). Much more refined in its story-finding algorithm. Works like a charm everywhere, so far, bringing my out-of-the-ass calculation to 98% correct.
2009-08-30 02:06:54 +00:00
Samuel Clay
615d1fb530
Whoops - scores should be set to *something*
2009-08-30 00:47:56 +00:00
Samuel Clay
9e522ca528
Woo - Checking for content and title differences to resolve duplicate entries. Integration tests prove a number of differences are successfully resolved.
2009-08-30 00:43:13 +00:00
Samuel Clay
bdd91d714d
Refactored the feed fetcher. Added integration tests for dupe matching. Also stubbed in AI score calculations so I can do something with the output soon.
2009-08-29 19:34:42 +00:00
Samuel Clay
3bd43a8cb4
Updating algorithm to insert the necessary base information into the feed's page.
2009-08-26 03:12:55 +00:00
Samuel Clay
d24b56fbf4
Adding new "Return to Page" button. When the user visits other pages in a feed, security prevents NB from reading the iframe, so we provide a convenient hook to bring the iframe back. Call it SnapBack, except, don't.
2009-08-26 02:31:35 +00:00