background preloader

Reddit dev

Facebook Twitter

Reddit with Amazon Cloud Search : redditdev. Please help me set cloudsearch - Google Groupes. Hi, There's no document yet available for setting up cloudsearch (you're the first to ask about it!)

Please help me set cloudsearch - Google Groupes

But I'll be happy to help you work through the kinks. It looks like you've been able to connect to your search endpoint, which is a great start. You'll want to configure the following index fields and relevance sorts. The first dump is for the domain associated with your CLOUDSEARCH_SEARCH_API endpoint: Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month. Continuing along in our quest to give you the tools that you need to build ridiculously powerful web sites and applications in no time flat at the lowest possible cost, I'd like to introduce you to Amazon CloudSearch.

Amazon CloudSearch - Start Searching in One Hour for Less Than $100 / Month

If you have ever searched Amazon.com, you've already used the technology that underlies CloudSearch. You can now have a very powerful and scalable search system (indexing and retrieval) up and running in less than an hour. You, sitting in your corporate cubicle, your coffee shop, or your dorm room, now have access to search technology at a very affordable price. You can start to take advantage of many years of Amazon R&D in the search space for just $0.12 per hour (I'll talk about pricing in depth later).

What is Search? Search does the same thing by indexing each document in a way that facilitates rapid retrieval. As is the case with many things, this simple model masks a lot of complexity and might raise a lot of questions in your mind. How efficient is the search? May I ask a question about the differences between the real reddit code who powers the site we're on and the Open Source version on GitHub? : redditdev. Kemitche comments on Does reddit using Amazon Cloud Search? How does reddit get the thumbnails/embeds for media? : redditdev. Admincom. The genuine news aggregator for the latest web buzz.

Reddit’s comment ranking algorithm. On a web site where users rate the quality of– well, just about anything, from consumer products to comments on news articles– with positive or negative “votes,” how should the rated items be sorted so as to present the higher-rated items near the top of the page and the lower-rated items near the bottom?

Reddit’s comment ranking algorithm

I recently learned how Reddit handles this problem when sorting user comments on a link post. (I was teased to the Reddit link by the title’s suggestion that Randall Munroe of xkcd fame had a hand in the algorithm.) There is some interesting mathematics involved… but there also appear to be some equally interesting bugs in the implementation, which I will discuss here. [Edit: Two of the three problems discussed here have been fixed.] First, some background, in chronological order: Evan Miller has a great write-up titled “How Not To Sort By Average Rating.” But let’s skip that and instead focus on the actual implementation in the Reddit source code. Where in their is intended. . , where. Reddit Upvotes Apache Cassandra for Horizontal Scaling; Managing 17,000,000 Votes Daily. Jason Harvey: Systems Administrator at Reddit Brady Gentile: Community Manager at DataStax TL;DR: Reddit started out as a place for people to go and post links, find interesting things on the Internet and share information with other people.

Reddit Upvotes Apache Cassandra for Horizontal Scaling; Managing 17,000,000 Votes Daily

Today it’s commonly known as the “front page of the internet”. Cassandra was selected at Reddit for its self-healing feature in terms of read-repair and horizontal scalability. Lessons Learned while at Reddit. Reddit CSS Tutorial - Part 3 Sidebar Image and Getting Rid of The Side Title. Atlassian Git Tutorial. Discussion.

Atlassian Git Tutorial

Setting up the reddit app without root access. We manage the servers for you which means that you don’t have to worry about setting them up and most importantly maintaining them.

Setting up the reddit app without root access

We provide a team of systems administrators who work around the clock to do things like applying security patches, monitoring servers, fixing server issues when they arise, building RPMs with new versions of tools and backing up your data. For this to work smoothly we have to make sure that our servers are set up in a certain way (with some standard linux tools and some of our own tools) and it means that you don’t get root access to the servers. In practice this is rarely an issue because you can usually install anything you need in your HOME directory, even when the tools’ installation guides assume that you do have root access. As an example we’re going to set up the reddit app on our servers. This is the code running the popular reddit.com website. 1. 2. Installing a reddit clone on your VPS. While aimlessly browsing through memes and other images of cats on reddit this past weekend, I came across a subreddit I had never seen before: redditdev.

Installing a reddit clone on your VPS

On this discovery, I realised for the first time that the reddit source code is open source, and even better, it’s written in Python! While I might have been slow to learn this fact, I was quick to test out this new found knowledge by immediately spinning up a VPS ready to deploy my own Reddit clone. This blog post is going to walk through the steps I took. Reddit install script for Ubuntu · reddit/reddit Wiki. New search! RedditAll.com - Read the reddit frontpage like never before. Enough of your borax, poindexter, we need action -- take me to redditAll.com!

RedditAll.com - Read the reddit frontpage like never before

The reddit front page is daunting to a number of casual Internet users, I know. But those blue verdana headlines won't be changing anytime soon (except on user-created reddits, where you can restyle all the CSS). So redditall.com is a new take on the front page that looks more like popurls (Thomas Marban has done brilliantly on that btw) only with different blocks from different chunks of the reddit network.

First, some history (scroll past this for the pictures): This idea started in a cracked (sorry, Jasc) copy of Paint Shop Pro 5 back in July 2005, shortly after Steve and I launched reddit.Connor, a college buddy of ours, and I were passing design ideas back and forth when we got to something that looked an awful lot like the 'web desktops' that were so hip at the time. As for the site itself, here's an overview: Reddit's new comment sorting system. Hey!

reddit's new comment sorting system

This is Randall from xkcd guest-blogging to explain reddit's new comment sorting system, which I pushed for pretty hard. Usually I illustrate blog posts with little drawings. Unfortunately, this one didn't lend itself to illustration, so I'm sorry if the drawings don't really relate to the material. reddit has a new comment sorting algorithm, the "Best" ranking (joining "Top", "Hot", "New", "Controversial", and "Old"). It affects only comments, not stories. davean (the xkcd sysadmin) wrote the patch, the system has been in trial for a week or so, and as of this morning has become the default way comments are sorted.

This is a very, very good thing. The algorithm is detailed here, in an article by Evan Miller (which I found last year on reddit). /r/python hits 10k subscribers! (so we rolled you this revision...) Self serve advertising on reddit is now open for business! After having our new sponsored link program in beta for the last 3 weeks, we're happy to announce that we've worked the bugs out (famous last words) and are opening it up to all users.

self serve advertising on reddit is now open for business!

To get started, simply click on the new "self-serve advertising" link in the footer on the front page, or, for the lazy, go here. Why did we take reddit down for 71 minutes? Reddit has a new rendering engine! (hopefully you didn't notice) As most of you know, reddit's commenting system uses a technology called Markdown that allows you to type stuff like: My [site]( is *really* cool. ...and have it rendered as:We get so many comments (and comment-viewings) per second that doing this translation has always been a major burden on our servers. The more CPU cycles we spend on it, the more application servers we need, and in turn the more connections going to our database servers, the more places we have to roll code out to, and all sorts of other growth problems.

But you shouldn't feel one ten-thousandth of a guilt unit over this news, because we've just switched our rendering engine from markdown.py (which is nothing to sneeze at and has served us well since the beginning) to a 100%-compatible, pure-C implementation of Markdown known as Discount. (Get it?) Tl;dr: If you see any wonky comments, tell us. P.S. Pls send me teh codez. You can now target sponsored links to particular communities, and rerun them without losing the comments. We've been very happy with the way that our sponsored link system has been used. Advertisers seem to have been pretty happy as well. Like all things that ain't broke, we decided, 'Let's fix it!

'" For the visual among you, TheOatmeal was nice enough to make us a walkthrough of the new system. Now this is how you pitch your product to an open source company. After our call to open source developers on Monday and the addition of our code repository to github, we've been ecstatic to see a flurry of activity in #reddit-dev on freenode as well as on our mailing list. We'd like to announce that our most recent accepted patch is from the gentlemen at a YCombinator start-up called embed.ly who, as you might have guessed, specialize in providing embeddable media using the open oEmbed standard. When a link gets submitted to reddit, within a few minutes of it appearing on the new page, we run it through a "media scraper" which is responsible for finding images to generate a thumbnail for the link as well as for finding any embedible content (such as videos).

Unfortunately, each provider generates their embed codes a little differently, and it has been cumbersome to keep our scrapers up to date. Enter embed.ly. Reddit's May 2010 "State of the Servers" report. We promised we'd make a blog post about last week's issues, but every time we sat down to write it, a new issue popped up. It's been a crappy week. Anyway, although we're still knee-deep in looking for ways to make the site more stable, it's probably time to write up that, uh, writeup. A better mobile reddit for all. It's been a long time in the making, but we're proud to announce the release of our new mobile interface. Fun in the sidebar. A few months ago, ketralnis came up with an interesting idea: When we have unused ad space, why not use it for something nice?

Quiet ads, new features, and an important video. By popular demand, we've spent the last few months experimenting with outsourced ad networks. They all do a great job ensuring we never have unsold ad space. But for the most part, they're terrible at quality control. Reddit mold is now live! Depending on your luck, you may have noticed that reddit looks a little different today. If you go to the site and the logo looks like this... How reddit works. This growth brings new diversity, new opportunities, and new challenges to our communities. There are now over 6,500 subreddits with over 100 subscribers. Saying goodbye to an old friend and revising the default subreddits. As of today the subreddit /r/reddit.com will be archived, and will not be accepting any more submissions. It's an artifact of an earlier, simpler time and has long since run its course. You'll still be able to see all of the submissions and comments, and PMing the mods of /r/reddit.com is still the best way to get in touch with the admins.

Reddit goodies and free stickers! January 2012 - State of the Servers. My fellow redditors: the state of our servers is strong. 2011 was a year of explosive growth and daunting technical hurdles. Our infrastructure has changed dramatically over the past 12 months. I'm here to show you some the more technical details of the changes that have been made, and dazzle you with fanciful talk of the future. To look at just the numbers, in December of 2010 we had 829 million pageviews and 119 servers. University of reddit - Explore any subject that interests you.

Imagine a university where you have the freedom to take whatever class sounds interesting. Imagine being able to choose freely from courses like Hindi 101, Algebraic Topology, 17th Century Italian Fencing, Abelton Live, The Art and Science of Making Great Beer, Neural Basis of Cognition, The Rise and Fall of the Roman Empire, or Starcraft II Strategy.

Now imagine not having to worry about attendance, grades, tuition, sharing personal information, or anything else but learning for learning's sake. Browse the Future of reddit: Re-Introducing Multireddits. This post is about a new reddit feature, multireddits. How FriendFeed uses MySQL to store schema-less data - Bret Taylor's blog. Reddit’s database has two tables. Remote Debugging Python with Eclipse and PyDev. Use eclipse and pydev to perform remote debug python app. - jmbkeyes.