Commit graph

986 commits

Author SHA1 Message Date
Samuel Clay
2fe65adc4d Re-enabling Google News fetches. 2013-09-11 10:50:20 -07:00
Samuel Clay
00a412960a Skipping google alerts. 2013-09-09 13:50:05 -07:00
Samuel Clay
2b2c731bd5 Fixing a couple exceptions and turning off google news rss feeds temporarily. 2013-09-09 13:46:14 -07:00
Samuel Clay
dec22ac776 Moving to simpler read story endpoint. 2013-09-06 12:42:39 -07:00
Samuel Clay
00179a9465 Fixing login name for sshdo. 2013-08-20 13:49:09 -07:00
Samuel Clay
f0f356287a Removing hard-coded path from ssh.sh. 2013-08-20 13:47:49 -07:00
Samuel Clay
6cf9c08662 Adding tlnbw to watch the work server. 2013-08-20 13:39:19 -07:00
Samuel Clay
311f879e30 Using ec2 keys for ec2 log tailing. 2013-08-20 13:13:54 -07:00
Samuel Clay
4d3444d28d Fixing tlnb for other users. Also fixing Paypal refund info. 2013-08-20 13:12:16 -07:00
Samuel Clay
1ff16938e3 Removing page fetches from munin. 2013-08-16 16:02:56 -07:00
Samuel Clay
c509177500 Adding redis backup for new redis stroy server. 2013-08-12 16:29:48 -07:00
Samuel Clay
2394e31f89 Moving feed parsing hotspot to specific seq ratio check. 2013-08-06 13:54:06 -07:00
Samuel Clay
ecf11eed98 Upping process feed time limit. 2013-08-06 13:42:53 -07:00
Samuel Clay
683140af2e Moving feed processing to timelimit due to some feeds sucking up all the time. 2013-08-06 13:38:35 -07:00
Samuel Clay
88f2a69a93 Fixing a dozen text and feed fetching bugs. 2013-08-06 13:18:55 -07:00
Samuel Clay
fb710c870f Beginning of a long 16-day migration of feed's redis story ids into 30 day retention from 14 day retention. Once this migration is complete, can up the DAYS_OF_UNREAD to 30 day with no issues, except for updating scores. 2013-08-02 15:59:03 -07:00
Samuel Clay
dfceb5bff1 Mongo backups using gzip instead of bzip2. 2013-08-01 19:11:47 -07:00
Samuel Clay
98d5ebd4f6 Fixing mongo backup script. 2013-08-01 18:15:40 -07:00
Samuel Clay
b8efcd0713 Fixing redis/mongo logging accidentally duping logs on fast requests. 2013-07-31 11:17:04 -07:00
Samuel Clay
d49e9569a5 Fixing #377. Killing XSS attacks by sanitizing feed titles. 2013-07-29 14:25:43 -07:00
Samuel Clay
acf215ab44 Updating fabfile to use new repo'd ssh keys. 2013-07-17 15:03:16 -07:00
Samuel Clay
4386b14beb Fixing broken content from RSS feed when summary is actually longer. 2013-07-16 11:59:52 -07:00
Samuel Clay
17ad34c7d0 Adding starred stories to munin. 2013-07-11 15:55:37 -07:00
Samuel Clay
ee5c00bce5 Using latest feedparser. 2013-07-10 16:10:19 -07:00
Samuel Clay
cf36df47fa Bumping feed blast limit from 50 to 100 stories at a time. 2013-07-10 15:13:19 -07:00
Samuel Clay
081dab415c Merge branch 'master' into full_view
* master:
  Normaling user agents between feed/page/icon fetchers. Adding full site permalink.
2013-07-10 11:41:23 -07:00
Samuel Clay
988f9f4314 Normaling user agents between feed/page/icon fetchers. Adding full site permalink. 2013-07-10 11:38:05 -07:00
Samuel Clay
6e6f5d1935 New view: full view, the opposite of list view. 2013-07-08 17:06:01 -07:00
Samuel Clay
6fda0b6a35 Timing out on PuSH hubs when down. 2013-07-01 18:46:21 -07:00
Samuel Clay
faffa91791 Adding simple website uptime checker. 2013-07-01 16:52:21 -07:00
Samuel Clay
20c4177fad Toning down the red in the logs. 2013-07-01 08:22:02 -07:00
Samuel Clay
0eb2ccf4eb Turning down color warning for original text. 2013-06-30 17:12:41 -07:00
Samuel Clay
e6da8d034d Showing loading bar in all views. Also being more aggressive in finding urls when adding. 2013-06-30 17:00:31 -07:00
Samuel Clay
b2f93cb75b Chunking story hash pipeline to let others in. 2013-06-28 19:09:34 -07:00
Samuel Clay
67b82a3a60 Converting lua script to multi/exec block. 2013-06-27 15:21:13 -07:00
Samuel Clay
2ade3b31e9 Fixing munin. 2013-06-26 13:03:44 -07:00
Samuel Clay
3f786a65c6 Banning Feed Reader Background app, as it's causing a ton of bogus requests. 2013-06-25 21:48:30 -07:00
Samuel Clay
5c184be4ae Feed reader bg in user client list. 2013-06-24 23:41:31 -07:00
Samuel Clay
78774ebb39 Adding new widnows phone clients to logs. 2013-06-24 23:27:47 -07:00
Samuel Clay
40f1243e02 Updating postgres backup. 2013-06-24 20:07:11 -07:00
Samuel Clay
7ec280e178 Refacotring node+work servers out of app servers. 2013-06-23 13:47:19 -07:00
Samuel Clay
2408156024 Reverting most PIL cleanup. 2013-06-21 13:15:04 -07:00
Samuel Clay
bb95ea8984 Cleaning up PIL. 2013-06-21 13:11:54 -07:00
Samuel Clay
9826a6499b Moving all pubsub to a dedicated redis box (called REDIS2). 2013-06-18 12:21:27 -07:00
Samuel Clay
47b32be408 Merge branch 'master' into offline
* master:
  Scheduling stale feeds for flat feed users, too.
  Normalizing user agents for better detectibility.
  Blocking dumb client apps without user agents.
  Adding user agent logging for api logins.
2013-06-15 12:52:57 -07:00
Samuel Clay
a9e3238b89 Normalizing user agents for better detectibility. 2013-06-15 09:09:03 -07:00
Samuel Clay
9748227ae9 Connection error handling on tlnb. 2013-06-14 12:31:47 -07:00
Samuel Clay
85120d3f99 Fixing Twitter sharing by upgrading to API v1.1. 2013-06-12 13:52:43 -07:00
Samuel Clay
78e2e399dd Refactoring tlnb for graceful and robust app server logging. 2013-06-09 23:04:01 -04:00
Samuel Clay
db23c948c7 Adding server name back to logging. 2013-06-09 02:45:17 -04:00