Commit graph

83 commits

Author SHA1 Message Date
Samuel Clay
34ad54e1f5 Fixing feed update times for inactive feeds to never go inadctive but to instead go into geometrically longer feed fetches. 2012-08-09 13:26:52 -07:00
Samuel Clay
a6f6ed2994 Merge branch 'master' into social
* master:
  Adding index to feed address. This will speed up imports.
2012-04-20 23:55:27 -07:00
Samuel Clay
13b2e40c8c Adding index to feed address. This will speed up imports. 2012-04-19 12:13:35 -07:00
Samuel Clay
ef6c92bf92 Merge branch 'master' into social
* master:
  Showing feed pushes in statistics.
  Instrumentation to count feed pushes.
  Migration to fix starred stories with incorrectly double-encoded url strings.
  Fixing bug around missing feed links being checked for length.

Conflicts:
	apps/rss_feeds/views.py
2012-04-09 15:19:25 -07:00
Samuel Clay
23280a86aa Migration to fix starred stories with incorrectly double-encoded url strings. 2012-04-09 14:32:57 -07:00
Samuel Clay
8efefc6cdb Merge branch 'master' into social
* master:
  Fixing hub url change subscription.
  Adding failed push feeds to munin.
  Showing correctly real-time status if feed is push.
  Showing correct real-time status if feed is push.
  Emergency fix to not have to reverse url in task fetchers.
  Setting up push feeds for removal.
  Adding munin graph for pushed feed queue and nginx conf.
  Logging real-time.
  Resubscribing to real-time feeds on add/remove feed.
  Adding push feeds queue. Ignoring fat ping, since it might not match URLs.
  Cleanup
  Forgive push subscription errors.
  Adding # of push feeds to munin.
  Correcting a double-encoding bug for story permalinks that was from way back when.
  Fixing the shit out of the feed fetcher's deleted feed handling. Also fixing PuSH support to correctly give parameters to PuSH server.
  Checking for push hub links safetly.
  Adding subscription callbacks for PuSH.
  Stubbing in PuSH support. Need to work it in with Feeds and upgrade rel='hub'.

Conflicts:
	apps/reader/models.py
	media/js/newsblur/reader/reader.js
	settings.py
	utils/feed_fetcher.py
2012-03-28 18:42:35 -07:00
Samuel Clay
abc3b20d81 Adding subscription callbacks for PuSH. 2012-03-27 16:26:07 -07:00
Samuel Clay
a2ee769895 Big cleanup on duplicate feeds with alternative feed links. Also fixing the profile to show followers/followings. 2012-03-12 18:11:13 -07:00
Samuel Clay
c9cb7dcbc0 Adding new feeds db column 'known_good', for forcing updates of feeds that were once good but are now throwing 500s. 2012-02-01 17:59:46 -08:00
Samuel Clay
ad007c7e61 Adding active_premium count. Setting a minimum of 1 hour fetches for feeds with any active premiums. 2012-01-09 19:08:22 -08:00
Samuel Clay
2d5cb775bb Removing dupe migration from feed_settings. 2011-11-27 02:42:42 -05:00
Samuel Clay
b0fba05185 Adding migration for unique hashes on feed addresses + links. 2011-11-23 16:59:46 -05:00
Samuel Clay
174d6febb6 Merge branch 'master' into feed_settings
* master:
  Adding linux.com story to press page.
  Uniqifying stories when read.
  Moving from sha module to hashlib.
  Syncing time to account for time drift on VPS.
  Fixing issue around showing too many Oh Nos on abort.
  Save hash for address+link migration. necessary for a unique index.
  Deprecating db02, moving redis and rabbitmq over to db01.
  Updating nginx conf to support better amintenance pages giving a 503 status code.
  Moving NewsBlur counts to beginning of title.
2011-11-23 15:09:42 -05:00
Samuel Clay
2fe7160bd9 Save hash for address+link migration. necessary for a unique index. 2011-11-18 15:32:14 -08:00
Samuel Clay
fe4c578337 Uniqifying address+link hash. Allowing feed_link branches, but it does not yet work. Needs proper dupe detection. 2011-11-16 09:29:05 -08:00
Samuel Clay
517248bead Adding two new columns, necessary for the feed_settings branch: hash of address+link, and locking address. 2011-11-15 22:14:21 -08:00
Samuel Clay
acfd9e7614 Adding feed.has_page to weed out feeds with no original page. This should've been in 2 years ago. 2011-09-04 10:59:29 -07:00
Samuel Clay
47556ec303 Locking feed links for testing. This also helps future feed links that need locking. Probsbly should include feed_address_lock's as well. 2011-09-01 09:34:57 -07:00
Samuel Clay
06a46993d2 Backup mongo + psql. Removing ridiculous FeedUpdateHistory table. 2011-05-18 14:36:31 -04:00
Samuel Clay
7b9df8dadc Anonymous users will see a warning on sending an email. Also removing FeedIcon model (having switched to the mongo MFeedIcon model). 2011-05-09 10:35:46 -04:00
Samuel Clay
6d04024340 Loading favicons for new users. Also not clobbering them when possible. 2011-05-01 18:57:19 -04:00
Samuel Clay
301657b0b7 Adding migrations for favicon data in the Feed directly. Speeds up load time. 2011-04-26 19:38:21 -04:00
Samuel Clay
4c16df13eb Adding feed classifiers counts. Will be used to display graphs which show likes and dislikes aggregated across users in the Statistics dialog. 2011-04-07 17:00:28 -04:00
Samuel Clay
7892dbec33 No need to change tagline's max_length on migration. 2011-02-06 15:43:13 -05:00
Samuel Clay
4fd6a7cfe0 Fixing a metric-ton of bugs: Google Reader import on badly parsed xml, refreshing toplevel feeds loses their manage menu, retrying exception feeds now de-dupes and correctly updates on the page. Plus a bunch of other bugs. 2011-02-06 15:04:21 -05:00
Samuel Clay
58ae33fd50 Dynamically updating feed icons as they load. 2011-01-30 21:40:00 -05:00
Samuel Clay
cae756390a Final cleanup before sending icons to staging. 2011-01-30 10:46:53 -05:00
Samuel Clay
27c633f0b0 Success on saving all images. Still some issues with transparency and resizing large images and having weird cutoffs. 2011-01-29 11:24:27 -05:00
Samuel Clay
a182bb1216 Finally saving proper base64 encoded favicons, along with their URLs, autodetecting when not found at /favicon.ico, and now all thats left is serving icons and their colors. Woohoo! 2011-01-27 19:05:50 -05:00
Samuel Clay
80de98662a Removing many psql tables that no longer do anything. 2011-01-17 23:24:30 -05:00
Samuel Clay
0ab880f855 Dropping a bunch of extra postgres tables. 2011-01-17 23:20:25 -05:00
Samuel Clay
443fe69156 Moving text fields from Feed to FeedData. Migration includes deletion of old fields on Feed, now unused. 2011-01-17 22:48:38 -05:00
Samuel Clay
b63b07484d Adding sanity checks in FeedData data migration. 2011-01-17 21:11:25 -05:00
Samuel Clay
ad0fea6c7c Adding sanity checks in FeedData data migration. 2011-01-17 21:07:56 -05:00
Samuel Clay
a105606874 Adding sanity checks in FeedData data migration. 2011-01-17 20:38:18 -05:00
Samuel Clay
67904dc2ef Adding sanity checks in FeedData data migration. 2011-01-17 20:32:07 -05:00
Samuel Clay
52dd582b56 Adding sanity checks in FeedData data migration. 2011-01-17 20:28:47 -05:00
Samuel Clay
ad3fbd269e Adding sanity checks in FeedData data migration. 2011-01-17 20:26:34 -05:00
Samuel Clay
b433fae866 Adding FeedData table to remove the extra text heavy ifnormation from the already too-cluttered Feed table. 2011-01-17 20:23:29 -05:00
Samuel Clay
a2b9d8cd81 Updating timezones to be django 1.3 compliant. Also adding index to active and active_subs fields on feeds table. 2011-01-17 13:52:25 -05:00
Samuel Clay
0c7d624990 Making the min_to_decay data migration much faster. 2011-01-15 19:12:11 -05:00
Samuel Clay
4f35c2fade Making feed.min_to_decay reflect the actual decay time. Using it in statistics, and refreshing it in feed fetching. Also splitting up feed munin. 2010-12-23 13:29:31 -05:00
Samuel Clay
b66080ca4d Fixing how duplicate feeds are handled and found. When a subscription is not found, check for duplicate feeds and then switch accordingly. When merging feeds, don't forget to bring along the dupe feed's dupe feeds. 2010-11-09 09:55:44 -05:00
Samuel Clay
5526d493b8 Null premium subscribers is OK. 2010-10-16 22:27:36 -04:00
Samuel Clay
bfa6c80778 Adding premium subscriber counts for all feeds. Still need to auto-update it when old usrs turn active again. 2010-10-06 10:21:14 -04:00
Samuel Clay
e849957a8f Changing default dates for feed models. 2010-10-02 17:16:01 -04:00
Samuel Clay
7e5dcb188a Adding munin graphs for feed loadtimes: averages, min, and max for the past hour and day. Going to be beautiful. 2010-09-23 10:29:18 -04:00
Samuel Clay
b61955c7f3 Fixing etag max_length, whcih was too short for certain websites and their giant-ass etags. 2010-09-17 13:06:28 -04:00
Samuel Clay
9792550dcc Counting only active subscribers in prep for turning off feed fetching for inactive users. 2010-09-17 12:42:44 -04:00
Samuel Clay
132c561be5 Queue date for feeds for better metrics. 2010-09-08 13:58:05 -07:00