Samuel Clay
|
7b08770b3a
|
Getting rid of Queues entirely. Replaced with values being distributed directly to Processes. One day this will change. Until then, all feeds fit in memory.
|
2009-09-16 03:54:33 +00:00 |
|
Samuel Clay
|
a7888c2aae
|
Switching from threads to processes. Sure, no big deal. Django is not thread-safe, so I can't use threads. I can, however, use multiprocessing to pass a Queue around between Processes.
|
2009-09-16 02:22:27 +00:00 |
|
Samuel Clay
|
0446ff2ee3
|
Adding locks to feed processing.
|
2009-09-12 20:42:38 +00:00 |
|
Samuel Clay
|
bec2f00979
|
Exiting after it's over.
|
2009-09-10 04:24:51 +00:00 |
|
Samuel Clay
|
0b9b778382
|
Queues not working. Reverting back to 1 feed at a time. Ugh.
|
2009-09-10 04:16:50 +00:00 |
|
Samuel Clay
|
8437ef29f1
|
Handling empty queues and increasing thread count
|
2009-09-10 03:52:43 +00:00 |
|
Samuel Clay
|
67ab0d6c66
|
Let's try changing the load.
|
2009-09-10 03:48:22 +00:00 |
|
Samuel Clay
|
02a4d292e8
|
Moving from threadpool to a Queue. Much simpler.
|
2009-09-10 03:33:05 +00:00 |
|
Samuel Clay
|
0caf49e9a4
|
OK. Turning on threading for feed fetching. Enough logging to catch the bugs. Fixed the segmentation fault on exit.
|
2009-09-10 02:31:55 +00:00 |
|
Samuel Clay
|
9e522ca528
|
Woo - Checking for content and title differences to resolve duplicate entries. Integration tests prove a number of differences are successfully resolved.
|
2009-08-30 00:43:13 +00:00 |
|
Samuel Clay
|
bdd91d714d
|
Refactored the feed fetcher. Added integration tests for dupe matching. Also stubbed in AI score calculations so I can do something with the output soon.
|
2009-08-29 19:34:42 +00:00 |
|
Samuel Clay
|
d24b56fbf4
|
Adding new "Return to Page" button. When the user visits other pages in a feed, security prevents NB from reading the iframe, so we provide a convenient hook to bring the iframe back. Call it SnapBack, except, don't.
|
2009-08-26 02:31:35 +00:00 |
|
Samuel Clay
|
ce9ec58d00
|
Some feeds don't have pages. Who knew.
|
2009-08-23 00:07:37 +00:00 |
|
Samuel Clay
|
9c522416a1
|
Gotta get rid of threading until I can figure out how to thread-safe the Django ORM. It's corrupting my tables!
|
2009-08-23 00:00:55 +00:00 |
|
Samuel Clay
|
fa123e7f3d
|
Updating feeds to crash with noise.
|
2009-08-21 13:14:44 +00:00 |
|
Samuel Clay
|
6cf04497ee
|
Checking for threadpool
|
2009-08-20 02:53:41 +00:00 |
|
Samuel Clay
|
8545e09d9a
|
Using threadpool module and feedjack to import feeds. Largely the same functionality, but now more debugging info, as well as better error handling and threads.
|
2009-08-20 02:43:01 +00:00 |
|
Samuel Clay
|
88ccfa7e77
|
Created admin commands to run refresh_feed/s without invoking Apache. Finally!
|
2009-08-14 01:48:21 +00:00 |
|