Commit graph

13019 commits

Author SHA1 Message Date
samuelclay
efcec910f3 Decompressing into unicode. 2010-01-27 16:44:45 -05:00
samuelclay
d9c7ae7771 Auto-compressing all stories and feeds at the db level for better database lookups. 2010-01-27 16:29:11 -05:00
samuelclay
d6b3e40dfb Let's kill that feed cache in 10 minutes, not 24 hours. 2010-01-26 20:40:54 -05:00
samuelclay
5ed1b06710 Opening the floodgates for proper counting. 2010-01-26 20:39:11 -05:00
samuelclay
2f196f428f Typo 2010-01-26 20:27:11 -05:00
samuelclay
6c635eb109 Reducing work of feed_fetcher to check a decent range of existing stories, now including one with explicit GUIDs, to prevent the bug where feeds show really old stories (like Daring Fireball's treatment of the Star stories). 2010-01-26 20:23:41 -05:00
Samuel Clay
a4f0b0f986 Adding debug info to trim_feeds 2010-01-26 20:02:36 -05:00
Samuel Clay
d748a41d85 Trimming > 1000 stories from feeds. 2010-01-26 19:59:43 -05:00
Samuel Clay
cdb0e65a3e Fixing unread counts dynamically reducing on reads. 2010-01-24 23:15:25 -05:00
Samuel Clay
1180100e37 - Fixing caching of feeds and users.
- Added loading indicator on new feed.
- Cleaned up numerous bugs around showing/hiding out-of-score stories.
2010-01-24 22:53:46 -05:00
Samuel Clay
98d4762735 Showing all unread counts at once, but only those higher than your current unread threshold. 2010-01-22 12:11:45 -05:00
Samuel Clay
4ed7f0e9d1 Success on reducing calculate_scores work. Now, to get it back in to feed_fetching. 2010-01-21 23:56:29 -05:00
Samuel Clay
9c814578c0 Reducing load of calculate_scores() 2010-01-21 23:50:03 -05:00
Samuel Clay
c6f86dad76 OK, for now, score calculation is too expensive to do on feed fetching. I'll run it manually until I figure out the best way to run it. For one, running 8 threads all calculating scores is *not* the way to go on a single db. 2010-01-21 22:23:42 -05:00
Samuel Clay
88cb715a28 Adding debug for calculate_scores 2010-01-21 17:56:54 -05:00
Samuel Clay
b1c72c5c9f Huge update: Hooking up slider to hide/show stories based on their score. Also added new story counts, score calculations, and real-time updating of unread counts as you read. 2010-01-21 13:12:29 -05:00
Samuel Clay
340ff31228 Adding jquery ui slider for some ui goodness soon. 2010-01-19 17:46:13 -05:00
Samuel Clay
b05a20c7c7 Moving the login box. 2010-01-18 00:09:26 -05:00
Samuel Clay
b5eb296e60 Backwards race condition. Two resources were executing independently of each other, when they really needed to block! 2010-01-18 00:07:46 -05:00
Samuel Clay
d27e80238a Updating algorithms for finding stories in the feed. Plus lots of refactoring for cleanliness. It is Sunday night, afterall. 2010-01-17 23:13:42 -05:00
Samuel Clay
87c9803600 Adding new Add Feed modal. 2010-01-17 22:11:17 -05:00
Samuel Clay
2610b5b0d3 I think I added a login button. 2010-01-17 20:00:12 -05:00
Samuel Clay
53255eb960 Adding .gitignore 2010-01-17 19:54:25 -05:00
Samuel Clay
6451cade96 Exponential speed-ups in determining story positions in the feed view pane. Thank you closures. 2010-01-17 18:18:51 +00:00
Samuel Clay
b16360462e Improvements to scrolling algorithm. Now more accurate scrolling. 2010-01-17 07:24:31 +00:00
Samuel Clay
d2d465d61b Removing logs from repo 2010-01-17 05:49:06 +00:00
Samuel Clay
f710424a0d Wahoo! Scrolling in iframe or feed view now auto-selects the correct story in the story titles pane. 2010-01-17 05:47:03 +00:00
Samuel Clay
35df77cdf6 Adding classification types for publishers vs. stories. 2010-01-12 01:19:37 +00:00
Samuel Clay
0c33bc84cb Adding intelligence button for feeds. 2010-01-07 00:04:12 +00:00
Samuel Clay
138f93cf43 All classifier facets and data is now saved, end to end. Now, to apply facets to incoming stories and assign scores. 2010-01-05 16:07:11 +00:00
Samuel Clay
ad40c429c6 Fixing closing of classifier modal. 2010-01-04 22:46:06 +00:00
Samuel Clay
923b7cd462 Turning off debug in production 2010-01-04 22:41:03 +00:00
Samuel Clay
8891a859fe Finishing up tags, and the classifier modal in the Reader. Now shows all sorts of classifiers. 2010-01-04 22:26:53 +00:00
Samuel Clay
ef70c288ed Adding a classifier to all stories. Classifies on:
- Story title (highlighted phrase)
- Story author
- Feed
2010-01-04 04:49:59 +00:00
Samuel Clay
838a57baa8 Fixing up sessions so they don't cache. Also adding Authors to admin. 2009-12-18 21:59:14 +00:00
Samuel Clay
f721021285 Really, debug is True until I release this thing. 2009-12-18 20:54:14 +00:00
Samuel Clay
44f89023ff Placing upper limits on dates 2009-12-18 20:49:38 +00:00
Samuel Clay
8bf5fc8dca Fixing the out-of-date dupe bug. 2009-12-18 20:47:44 +00:00
Samuel Clay
f518e10ea1 Ignoring logs 2009-12-18 18:31:04 +00:00
Samuel Clay
b216ebf48a Adding a tokenizer to the classifier, as well as using Divmod's Reverend Bayesian classifier. 2009-12-18 18:29:34 +00:00
Samuel Clay
06e94610dc Adding Phrase Filter to Analyzer. Just need to hook up the phrase filter to the story classifier and then save the results to be used for later processing. 2009-11-15 18:57:53 +00:00
Samuel Clay
d2c71e12f8 Moving the logo down 2009-11-15 18:49:37 +00:00
Samuel Clay
bc47a70058 Fixed numerous issues with story finding on frame page. And refactored switcheroo functions. 2009-11-08 03:26:54 +00:00
Samuel Clay
5fa009113c Moving around the like/dislike buttons to a per-story basis in the story-titles section of the page. 2009-11-03 20:25:40 +00:00
Samuel Clay
fb6d0692ce Naive Fisher Bayesian Classifier. Stubbed in some boilerplate for making the analyzer do its job. Still have to connect it to feeds and train on real data, but it's looking good as a starting point. 2009-11-03 03:52:03 +00:00
Samuel Clay
0edbb7ed74 I just don't feel comfortable with Django's thread-unsafe ORM. Putting locks back in place around all database .save() calls. It's The Right Thing To Do. 2009-09-16 04:00:37 +00:00
Samuel Clay
19df861456 Forgot to remove tests. 2009-09-16 03:56:58 +00:00
Samuel Clay
7b08770b3a Getting rid of Queues entirely. Replaced with values being distributed directly to Processes. One day this will change. Until then, all feeds fit in memory. 2009-09-16 03:54:33 +00:00
Samuel Clay
e06b736c5b Split the db connection between multiple Processes. To do this, you must close the db connection at the Process creation, so the process can re-create its own connection. 2009-09-16 02:39:45 +00:00
Samuel Clay
4aa0271047 Adding semaphore locks on all mysql db requests in threads/processes. 2009-09-16 02:34:04 +00:00