Commit graph

1095 commits

Author SHA1 Message Date
Samuel Clay
c2137d5230 Adding starred stories to mongo backup. 2011-01-04 09:05:11 -05:00
Samuel Clay
4f35c2fade Making feed.min_to_decay reflect the actual decay time. Using it in statistics, and refreshing it in feed fetching. Also splitting up feed munin. 2010-12-23 13:29:31 -05:00
Samuel Clay
12891aabcf Let's try using dates again in feed fetching existance checks. 2010-12-16 17:25:51 -05:00
Samuel Clay
6d8c34c752 Are story dates the problem? 2010-12-16 17:16:09 -05:00
Samuel Clay
ae4646e979 Nice middle ground between guids and dates. Now only retrieving as many guids are in the feed, but then comparing them with N stories. Very old stories shouldnt change, and they'll get thwarted by an IntegrityCheck. 2010-12-16 17:10:13 -05:00
Samuel Clay
5b3f199852 OK, a bit too aggressive on the story loading. Sticking to simple queries for now. 2010-12-16 17:00:08 -05:00
Samuel Clay
86af737159 Experimental feed difference change. More expensive, but will detect when things are actually changing. 2010-12-16 16:52:00 -05:00
Samuel Clay
a4e079d84b Cleaning up psql backup. 2010-12-16 14:09:15 -05:00
Samuel Clay
79e1784c97 Cleaning up psql backup. 2010-12-16 14:03:03 -05:00
Samuel Clay
74432e6dbb Cleaning up psql backup. 2010-12-16 13:55:32 -05:00
Samuel Clay
90d0a3132f Fabfile to deploy app and celery. Also to run backups. 2010-12-16 13:54:09 -05:00
Samuel Clay
a6818219d7 Fixing feed parsing for stories with dict ids. This includes all Google Reader feeds and Google News Alerts. Thanks to Richard <richard@lbrc.org>. 2010-12-10 15:58:21 -05:00
Samuel Clay
144b04feb6 Minor fix to feed fetching -- retry a feed with a bad HTTP status code but an OK feed link which points to a new feed address. 2010-12-10 09:32:06 -05:00
Samuel Clay
5f1a8741e0 Ignoring typeerror on imporperly formatting log strings in colorize. 2010-12-07 23:58:01 -05:00
Samuel Clay
37028cc5ed Forcing unicode string on formatted log exception. 2010-12-07 23:51:58 -05:00
Samuel Clay
c5895a7065 Forcing unicode string on formatted log exception. 2010-12-07 23:45:08 -05:00
Samuel Clay
92f4778ca7 Don't re-color debug messages. 2010-12-06 12:11:28 -05:00
Samuel Clay
e437bd4bb7 A whole bunch of colored logs. 2010-12-05 23:20:32 -05:00
Samuel Clay
cbe5df95aa A few color logging tweaks. 2010-12-05 17:15:58 -05:00
Samuel Clay
c1d1067c31 Anonymous User color tweak in logging. 2010-12-05 17:01:14 -05:00
Samuel Clay
9f4cdf2288 A few color logging tweaks. 2010-12-05 16:59:48 -05:00
Samuel Clay
397fd61c5f Adding color throughout the logs. It's crazy gorgeous and easy to follow what's happening on the site from across the room. 2010-12-05 16:56:33 -05:00
Samuel Clay
6e2c71124c Merge branch 'master' of github.com:samuelclay/NewsBlur 2010-11-26 14:28:22 -05:00
Samuel Clay
7ae833006f Adding +x permissions to psql backup script. 2010-11-26 14:28:17 -05:00
Samuel Clay
51756c7bc7 Uploading the correct psql backup to s3. 2010-11-26 14:27:48 -05:00
Samuel Clay
da48e2d0d0 Adding postgres backup script. 2010-11-26 14:26:08 -05:00
Samuel Clay
8da2ca00d3 Adding in S3 backup to mongo collection backups. 2010-11-26 14:09:29 -05:00
Samuel Clay
61128e00fe Outputting mongodump command for debugging. 2010-11-26 13:54:26 -05:00
Samuel Clay
a9937e3b01 Fixing minor syntax errors and turning off fsync lock for backups. 2010-11-26 13:40:09 -05:00
Samuel Clay
917e67cd77 Trying out a slightly different syntax to create shell script loops. 2010-11-26 13:35:19 -05:00
Samuel Clay
5aeb97ebee Bash script for backing up on a single line. 2010-11-26 13:29:25 -05:00
Samuel Clay
74d77ae189 Whoops, need an fsync unlock. 2010-11-26 13:27:49 -05:00
Samuel Clay
6993c465fc Reformatting to match bash syntax. 2010-11-26 13:27:16 -05:00
Samuel Clay
49db37678a Reformatting to match bash syntax. 2010-11-26 13:26:58 -05:00
Samuel Clay
de3f5c77eb Adding mongo backup scripts to handle db lock, exporting data, compressing, and uploading to s3. 2010-11-26 13:23:27 -05:00
Samuel Clay
67bbd4abfb Fixing munin graphs for feeds. Adding exception_feeds/pages. 2010-11-13 19:31:02 -05:00
Samuel Clay
7a066b08fb Simplifying munin graph for feeds. 2010-11-10 18:41:57 -05:00
Samuel Clay
d25c2dd65f Only calculate unread scores for active feeds and active users. 2010-11-10 18:22:33 -05:00
Samuel Clay
fa663e910a Faster feed refreshing (insta-fetching) by only computing the score for the current user and leaving the other users with dirty subscriptions. 2010-11-10 18:04:17 -05:00
Samuel Clay
e7646d7e98 Adding change password to Preferences. Also changing timing for feed updates. 2010-11-08 12:09:55 -05:00
Samuel Clay
8c373c336b Deleting old read stories. 2010-11-08 11:30:06 -05:00
Samuel Clay
afa9e53a4c Forcing refresh of feed model at opportune times in the feed fetcher. 2010-11-05 23:36:00 -04:00
Samuel Clay
7ca9b2bee5 Undoing connection close on feed fetcher. If they are being tasked, they don't need to close the connection. 2010-11-05 22:12:35 -04:00
Samuel Clay
b30752a9c1 A huge slew of bug fixes related to feed fetching, missing ids, and missing feeds. 2010-11-05 20:34:17 -04:00
Samuel Clay
80fa9aa6fd Cutting unread count timeout cutoff by a half. 2010-11-05 15:06:54 -04:00
Samuel Clay
71a32b3120 Refactoring feed unread calculation to allow for timeouts. Now counts in order of last read date for subscriptions. 2010-11-05 12:53:02 -04:00
Samuel Clay
314418558d Only recalculating feed scores for active subscriptions. 2010-11-05 12:12:14 -04:00
Samuel Clay
9892670377 Correctly handling 404s when in JSON views. 2010-11-04 19:28:35 -04:00
Samuel Clay
5d4783606b Fixing feed_fetcher to not puke on its entire queue when fixing a dupe. 2010-11-03 21:41:43 -04:00
Samuel Clay
786b3d9982 Fixed a bunch fo bugs around feed chooser, OPML import, google reader import, and counts. Also added preferences for new windows, timezone support, and default views. This is one loaded commit. 2010-10-30 00:27:52 -04:00