上位 200 件のコメント全て表示する 308

[–]j0be 301ポイント302ポイント  (133子コメント)

Question

Does this track which user clicks links, or is it anonymized? If it isn't, this could be a privacy concern for some users

[–]DrDuPont 116ポイント117ポイント  (93子コメント)

I would really appreciate this being answered. Will there be a database containing a list of links that my account has clicked?

[–]Drunken_Economist 47ポイント48ポイント  (82子コメント)

The data will be used in various aggregations ("how many people clicked link XYZ?", "What subreddits have the highest click rates for non-image links?", etc). It isn't technically impossible for use to write a query that says "What did DrDuPont click yesterday", but I feel pretty strongly about maintaining users' privacy.

It's similar to how we build the subreddit stats page. A query runs and says "how many users requested an /r/AskReddit page?". Even though it's possible for us to write a "What pages did DrDuPont request" query (like it would be for any website), it's not consistent with out belief about proper handling of user data.

[–]Pastries 46ポイント47ポイント  (10子コメント)

Will the data be deleted when an account is deleted?

[–]XGreenstarz 11ポイント12ポイント  (4子コメント)

NOPE why would it be when data storage is like less then pennies and terabyte drives are like hella cheap

[–]TheDoubleDMeansValue 20ポイント21ポイント  (0子コメント)

See, he wasn’t asking because he was worried Reddit was running out of storage…

[–]m1ss1ontomars2k4 5ポイント6ポイント  (2子コメント)

Well, they have been scrubbing deleted accounts recently, for reasons that have nothing to do with storage.

[–]guywithtwohats 3ポイント4ポイント  (1子コメント)

What do you mean by "scrubbing"?

[–]rambi2222 7ポイント8ポイント  (0子コメント)

Selectively deleting information.

[–]jaggededge13 1ポイント2ポイント  (2子コメント)

did you not read the comment? even though they CAN write a "this person clicked this link" recording script, it doesn't make sense to, as they aren't trying to recommend pages to you. they are trying to gather data about what pages are most clicked.

If they DO start recording data on who clicked what, then once an account is deleted, they would have no reason to maintain data past the raw numbers of what was clicked, since it wouldn't be of much use for prioritizing what is listed in "top posts" for that person. Sure it could also be used to send to the government, but basically nothing else. And that kinda goes against reddit's whole thing. they maintain enough to say they have some, but not enough that they have anything substantial to show the government if its requested.

[–]eduardog3000 81ポイント82ポイント  (66子コメント)

but I feel pretty strongly about maintaining users' privacy.

Yet the data isn't anonymous...

[–]Drunken_Economist[A] 46ポイント47ポイント  (65子コメント)

Mostly because there isn't much point — it can only be as anonymous as your account is.

Imagine this scenario. We run the user ids of our events (including clicks) through a one-way hash. Now we have an irreversible user id hash. Awesome.

We want to know how many users click a given link before commenting, and how many comment before clicking. Easy! I use the comment event, which also runs its user id through the same one-way hash to anonymize the data, joining the tables of the two events on the hashed user id.

Well . . . now there's our hole. Because I have a timestamp and some context info (subreddit, thing id, parent) for your comment and I can very easily go find the comment on the site and just look at the username next to it. There's eventually a gap where we have to store your actual username and user id somewhere, since we display it on the site.

Our solution is to treat the data with respect and clamp it down under the privacy policy (which I encourage you to read, it's really accessibly written).

There's always a fine balance between making sure you have enough useful data and protecting the privacy of the users. I think reddit has done a good job of finding the sweet spot over the last year, and I know I'm not alone in that.

[–]evman182 245ポイント246ポイント  (32子コメント)

I think your minimizing how serious a potential privacy issue you're creating. This needs to be opt-in (or at least opt-out). You are going to have a database linking users to what external links they are clicking on. This is potentially tremendously more sensitive than what self-posts someone clicks on.

Then you're asking me to trust you. Then you're also asking me to trust the people who work at reddit in the future. Just because I like the people in charge now doesn't mean I will in 5 years, and there's always the potential for a hack, or a leak. It's better to not have the dataset at all.

This is not a little thing. This should go out to announcements or the blog.

[–]sathoro 9ポイント10ポイント  (26子コメント)

Their server logs already know which pages you are looking at, and the links that are available on those pages. So I don't think it is that much of a privacy concern to track exactly what link you actually click on. If you want that level of anonymity you should browse while not logged in and through a VPN or Tor because with or without this feature they could already guess to some extent whether you have clicked a link or not such as by you having voted on the submission, viewed the comments, etc.

[–]cojoco 54ポイント55ポイント  (23子コメント)

Their server logs already know which pages you are looking at

That is not true. Currently, clicking a link bypasses reddit completely, going directly to the URL of the submission.

[–]Drunken_Economist 9ポイント10ポイント  (15子コメント)

I think he means the server logs know you requested "reddit.com/r/SecretKarmaCabal", and that that page contained links to "BuyFreeUpvotes.com", "CashForKarma.com", etc . . . not necessarily that which of those links you clicked on

[–]cojoco 80ポイント81ポイント  (12子コメント)

This might well create some moral quandries in the future.

Two questions:

It is currently illegal for some US Federal employees to look at WikiLeaks material. If requested by LE, you would have to release IP addresses of people who had clicked links to examine WikiLeaks. In this case, wouldn't it have been better not to know?

How can you be sure that Amazon or some government agency is not looking over your shoulder to collect this information directly from your databases, on a wholesale or case-by-case basis? (this one goes for all of the user information kept by reddit, of course!)

[–]sathoro 5ポイント6ポイント  (2子コメント)

I mean that they log which pages on reddit you are looking at. I would have specified, but I thought it was obvious from the rest of the context of my comment

[–]cojoco 5ポイント6ポイント  (1子コメント)

By "looking at", I assume you mean the headlines, not the webpages.

This change results in reddit logging the links that one clicks, which is a major change.

[–]evman182 1ポイント2ポイント  (1子コメント)

I'm not sure that you're right that they could easily reconstruct what a user's front page listing would look like at a given time or what they clicked on since logged in front pages are generated at the time of the request based on all the vote counts and age of the posts at the time, and if I go through 2 to 3 pages, it's likely that I've only clicked on a handful of the 75 links.

I'd also posit (and I think the data they collect will show this) that the vast majority of users are clicking on links without actually voting or commenting.

[–]sathoro 1ポイント2ポイント  (0子コメント)

They don't need to reconstruct it, they can just store the IDs of every post that has been shown to each user. That is incredibly easy to do

[–]Hubris2 2ポイント3ポイント  (3子コメント)

You know what they say - if you aren't paying for a service, then you are the product.

[–]sysop073 1ポイント2ポイント  (0子コメント)

They say that because it sounds a lot more insidious than "if you aren't paying for a service, it's probably funded through ads". "You are the product" sounds like reddit is selling your soul to the highest bidder

[–]emergent_properties 1ポイント2ポイント  (0子コメント)

You are going to have a database linking users to what external links they are clicking on.

IMO, this needs to sink in.

Regardless of the wordcount justifying WHY, your quote is the NET result. The NET result is the important part.

[–]localhorst 72ポイント73ポイント  (21子コメント)

Mostly because there isn't much point — it can only be as anonymous as your account is.

That's why one shouldn't collect such information in the first place. The value of privacy is much higher than doing some statistics for fun.

[–]Drunken_Economist 21ポイント22ポイント  (20子コメント)

Although I really do enjoy my job, it's not "doing some statistics for fun". It's more about informing decisions on the site.

I mentioned elsewhere that it will help us gauge the impact of spam (how many people see spam? how many click it?), but it will also drive more traditional product decisions. We can effect changes that encourage users to read linked articles before commenting, we can (as /u/novov mentioned) change vote weights for users who have clicked through instead of voting based on headline . . . we can find the change in rates of clickthrough for different types of content (images vs articles vs self posts) and use that to inform future decisions. We could determine the "reach" of a subreddit — how many people visit + how many click from their frontpage and help mods understand how their changes affect users.

These data will be really valuable in helping build a better experience for our users, moreso than almost any other data point.

We've always been redditors first, and employees second.

[–]markevens 40ポイント41ポイント  (0子コメント)

That kind of data is highly sought after from advertisers.

This looks to me like a half step in the direction of selling user data to advertisers.

Step 1: Start collecting data in the name of "it will be interesting to see"

Step 2: Sell the data

[–]localhorst 60ポイント61ポイント  (8子コメント)

A lot of people use reddit for a lot of different things. And this very private data. Collecting it in one point is very dangerous, e.g. you can link political opinions to porn habits, just to mention one obvious possible misuse. When you balance a human right like privacy against possible slight improvements of a web site, the human right should win.

I mentioned elsewhere that it will help us gauge the impact of spam (how many people see spam? how many click it?),

This information may be of interest to advertisers and other spammers, but not users.

We can effect changes that encourage users to read linked articles before commenting, we can (as /u/novov mentioned) change vote weights for users who have clicked through instead of voting based on headline

This may or may not slightly improve the web site but in my experience low quality content comes almost exclusively from image post and “circle jerk” articles that agree with most readers (e.g. look at /r/politics).

Why not try improving quality w/o violating privacy first? I haven’t noticed any attempts in this direction.

These data will be really valuable in helping build a better experience for our users,

IMHO this assertion needs very good evidence before implementing it. The downside is just too strong.

And we know that the data is not safe. Privacy policies change and spies, governments, corporations, and other criminals are after any data they can get hold on. And this data can be vary valuable.

[–]CuilRunnings 12ポイント13ポイント  (0子コメント)

These data will be really valuable in helping build a better experience for our user shareholder value

FTFY. If you cared about the users you'd give communities protections against abusive moderators.

[–]motrjay 33ポイント34ポイント  (0子コメント)

This is a huge privacy concern and I am not seeing a strong enough justification for collecting this data, whats the business justification that requires lowering reddits privacy standards, what payback is going to be seen in order to justify this?

[–]kardos 22ポイント23ポイント  (2子コメント)

We've always been redditors first, and employees second.

If true, then it's not a stretch to add an option in user preferences to disable the redirect layer, that is, make it opt-out.

[–]yukeake 7ポイント8ポイント  (1子コメント)

Unless it's plastered all over every page on the site, it really needs to be opt-in. Opt-out preys on ignorance, and unless someone was actively watching this discussion, or is otherwise informed, they wouldn't know that this was being done, and thus wouldn't know to opt-out.

[–]manwithabadheart 6ポイント7ポイント  (0子コメント)

Is there any way, currently, to opt-out of this tracking?

[–]fdagpigj 10ポイント11ポイント  (0子コメント)

change vote weights for users who have clicked through instead of voting based on headline

But clicking on something doesn't mean you read it. If you implement something like that, people will just end up clicking the links just to make their votes count, and maybe closing the linked article before even viewing it.

[–]DEADB33F 1ポイント2ポイント  (0子コメント)

Does this mean that you are categorically stating that there are no plans (short or long term) to sell the data that is collected?

Has there been any discussion about the possibility of selling the collected data?

[–]objectivedesigning 2ポイント3ポイント  (0子コメント)

"We can find the change in rates of clickthrough for different types of content use that to inform future decisions."

What kind of future decisions? We are starting to hear a lot more about big data being used to manipulate behavior. I don't find the idea that Reddit plans to engage in this kind of research particularly appealing.

[–]fearghul 1ポイント2ポイント  (0子コメント)

Quick point for you, if this is data NOT anonymized then you may have some serious issues with european data protection laws and might want to be sure your legal folks look over this.

[–]CuilRunnings 23ポイント24ポイント  (1子コメント)

We may share information if we believe your actions are inconsistent with our user agreements, rules, or other Reddit policies, or to protect the rights, property, and safety of ourselves and others;

So broad.

[–]Ripdog 9ポイント10ポイント  (0子コメント)

"If we feel like it" basically. Ugh.

[–]work-out-for-me 6ポイント7ポイント  (0子コメント)

(which I encourage you to read, it's really accessibly written).

I'm sure it's worded very carefully.

[–]street_medic 2ポイント3ポイント  (0子コメント)

Could you take a salted hash of the user's account name and use that as the index? This would allow all the stats you are talking about but decouple the data from the actual users account.

Thank you for openly discussing this change and answering our questions!

[–]janne-bananne 3ポイント4ポイント  (0子コメント)

You realize that this action can be illegal if you store it for over 6 months of users from the EU, and can get you banned from making business with any corporation in the EU (including banks, PayPal, etc)?

[–]koproller 1ポイント2ポイント  (0子コメント)

Hey, I remember you.
Who made you admin?

[–]Speculum 1ポイント2ポイント  (0子コメント)

I think reddit has done a good job of finding the sweet spot over the last year, and I know I'm not alone in that.

No, you haven't done it and you know it.

[–]3rssi 1ポイント2ポイント  (0子コメント)

one-way hash

It makes sense when compared to an open list such as passwords. Not on a reasonably sized list such as a user list:

Who upvoted dickpic.jpg?

L_Anonymous=getOneWayHashedUpvoters("dickpic.jpg")
for user in getRedditUsers():
    if isActive(user):
        if oneWayHash(user) in L_Anonymous:
            print "not so anonymous, mr"+getName(user)

[–]iamapizza 31ポイント32ポイント  (0子コメント)

From the previous announcement:

Individually, you have control over what information you share with us and what your browser sends to us automatically.

At the very least, there needs to be an opt out, and this needs to be announced to a wider audience. I feel you're downplaying this a bit much.

[–]asskisser 1ポイント2ポイント  (0子コメント)

why has this happened to reddit?

why do you care what people click?

[–]CuilRunnings 2ポイント3ポイント  (0子コメント)

it's not consistent with out belief about proper handling of user data

Is this like your belief in free speech? Now or when Alexis called it a bastion?

[–]umbrae[S] 38ポイント39ポイント  (38子コメント)

It does track which user clicks the links. I agree that there could be a privacy concern for some folks, although it's not vastly different from, say, clicking a link that goes to a self post, which we are already able to see in our server logs. We don't share this data with any third parties, so it's pretty similar to our server logs.

[–]Pastries 90ポイント91ポイント  (21子コメント)

A per-user option to disable this would be greatly appreciated.

[–]andytuba 54ポイント55ポイント  (16子コメント)

[–]TheEnigmaBlade 15ポイント16ポイント  (0子コメント)

IIRC, "do not track" applies to the prevention of loading third-party tracking services. As this change seems to be built-in to Reddit, it's likely not covered by DNT. Here's the relevant statement from the privacy policy:

When you have DNT enabled, we may still use information collected for analytics and measurement purposes or to otherwise provide our Services (e.g., reddit.com buttons), but we will not load any third-party trackers.

[–]umbrae[S] 9ポイント10ポイント  (14子コメント)

/u/TheEnigmaBlade is pretty spot on. In this case we're the only party, so it's pretty similar to a server log for a self post or the like. That said, we're privacy conscious too (and our CEO especially so, which informs a whole lot), so we'll still be thinking about ways to make reddit more privacy friendly. We already think about this a lot.

[–]localhorst 67ポイント68ポイント  (0子コメント)

That said, we're privacy conscious too (and our CEO especially so, which informs a whole lot), so we'll still be thinking about ways to make reddit more privacy friendly.

Right now you doing the opposite. You are making reddit less privacy friendly.

[–]localhorst 22ポイント23ポイント  (3子コメント)

/u/TheEnigmaBlade is pretty spot on

This is your interpretation. From the wikipedia article:

The Do Not Track (DNT) header is the proposed HTTP header field DNT that requests that a web application disable either its tracking or cross-site user tracking (the ambiguity remains unresolved) of an individual user.

I would argue the other way around: Setting DNT clearly states that the user does not wish to be spied on. You are not honoring this wish.

[–]TheEnigmaBlade 8ポイント9ポイント  (1子コメント)

Mozilla considers DNT to cover third-party tracking, and the EFF considers first-party tracking to be a reasonable exception. The DNT website also says this:

Do Not Track is a technology and policy proposal that enables users to opt out of tracking by websites they do not visit...

So while there is no absolute definition, setting DNT seems to state the user does not want to be spied on by third-party tracking services.

[–]localhorst 5ポイント6ポイント  (0子コメント)

The mere fact that we are discussing this shows that there is room for interpretation.

Anyways, /u/Pastries has the solution. Let’s see what /u/umbrae or /u/Drunken_Economist will have to say about it.

[–]arebokert 12ポイント13ポイント  (0子コメント)

Yeah you see, that data is private until you get hacked. That's why people are outraged about this.

[–]KublaiKHAAAN 8ポイント9ポイント  (0子コメント)

When is this change coming in?

Will there be an option to opt out of this?
This is not privacy friendly at all.

[–]ghoti_styx 5ポイント6ポイント  (0子コメント)

Thinking is cheap, talking about thinking even more so. What you actually do is all that matters.

[–]NihiloZero 10ポイント11ポイント  (0子コメント)

This reminds me very much of Hillary Clinton saying "I'll look into it" in regard to releasing the transcripts of speeches to Wall Street.

[–]blueredscreen 4ポイント5ポイント  (2子コメント)

tl;dr: Should I be worried about this or not?

[–]wipeout4wh 14ポイント15ポイント  (0子コメント)

Yes. They're reducing our level of privacy and playing the politics game to defend themselves. It's a bullshit decision by reddit and it's unacceptable.

[–]Speculum 1ポイント2ポイント  (0子コメント)

That said, we're privacy conscious too (and our CEO especially so, which informs a whole lot), so we'll still be thinking about ways to make reddit more privacy friendly.

Cut the crap.

[–]formode 1ポイント2ポイント  (0子コメント)

Unfortunately that's not what you're doing.

No one cares if your CEO is "privacy conscious", they don't control the company (the company that owns your company does) nor will they be there for the entire duration our data is stored on your company servers. We've seen Reddit's CEO change and their policies change.

In fact this very change your making is eroding privacy. I hope your metrics will be screwy because people will use things like this to get around it.

[–]wipeout4wh 16ポイント17ポイント  (0子コメント)

A per-user option to disable this would be greatly appreciated absolutely fucking required.

[–]toomuchtodotoday 22ポイント23ポイント  (2子コメント)

Or a modification to Reddit Enhancement Suite that bypasses this click tracking.

EDIT: I'm not against click tracking. I just want the ability to opt-out. I don't like the idea of Reddit having data on me forever with the constant changing of the guard.

[–]TelicAstraeus 17ポイント18ポイント  (1子コメント)

"We will never ever do bad things with your data, we promise!"

<change in ownership/management>

"We're rolling out a new improved privacy policy which is complicated but trust us when we say that you have nothing to worry about. :)"

[–]1000_Lemmings 26ポイント27ポイント  (0子コメント)

This is a concern for all redditors as well as those who are not registered (IP address). It seems you're playing the tired "if you have nothing to hide ..." card. Well, maybe not all would be concerned, but I hope you'd agree that it should be of considered by all. I'd also hope Reddit would take the high road and make DNT default, in light of what amounts to users' lack of knowledge about privacy issues. Barton Gellman addressed that in an interview (full transcript) about privacy after he helped break Edward Snowden's initial revelations.

Gellman: "I don't know whether I've ever met someone who truly has nothing to hide. If you think that's you, post a link to everything on your phone, your computer, your email accounts and your web browsing and purchasing history. And even if you have no secrets, you're probably in possession of the secrets of others -- the friend who is going to leave her husband, or wants to find a new job, or just got diagnosed with something she does not want people to know about. Privacy is relational. We may tell things to our friends we don't tell our parents or our kids, and so on. I want control of my own secrets, personal and professional."

I'll add that persons may have information that they may not even know is "secret," or at least sensitive and of interest to others who's interest in that information is not without mal intent.

This isn't the first Reddit policy change that's made me consider deleting my account, but it is certainly the most powerful.

Get real: you're giving lip service to user privacy concerns & have decided to disrespect them -- even to put them in harms' way in some cases -- not only in their contexts as users, but in that of their entire lives and their relationships.

EDIT: (post-coffee brush-up)

[–]cojoco 17ポイント18ポイント  (4子コメント)

We don't share this data with any third parties, so it's pretty similar to our server logs.

Would you share this data with law enforcement of any country if requested to do so?

[–]brainmydamage 24ポイント25ポイント  (3子コメント)

The answer is almost certainly yes.

[–]cojoco 3ポイント4ポイント  (2子コメント)

Which countries?

[–]wipeout4wh 19ポイント20ポイント  (0子コメント)

All of them. The fact that they refuse to answer this question is the only answer you need.

[–]brainmydamage 4ポイント5ポイント  (0子コメント)

I believe their servers are all US based, so, US, at the very least.

[–]Doctor_McKay 26ポイント27ポイント  (0子コメント)

This seems to go against Reddit's philosophy from only a few years ago. When the purple-across-computers gold feature was added, it was disabled by default because of privacy concerns.

[–]j0be 23ポイント24ポイント  (2子コメント)

Ok. So that brings me to a second question. I know Reddit publishes their DMCA requests, but is there anywhere that has requests for information?

Purely hypothetical, but what if Bahrain (solely as an example) requests all the links a specific dissenter has clicked on reddit which they've linked to an account?

[–]TonyQuark 15ポイント16ポイント  (1子コメント)

/u/spez answered a somewhat similar question here.

[–]xbbdc 3ポイント4ポイント  (0子コメント)

although it's not vastly different from, say, clicking a link that goes to a self post

Of course it's different. A self post stays within reddit, and external links are outside of reddit which you now want to track, probably for advertisers.

[–]verdatum 2ポイント3ポイント  (1子コメント)

Ya know, It'd be pretty easy to one-way hash the userid. It wouldn't be a complete solution, but it would help to anonymize the storage in the DB in case of a breach.

[–]j0be 42ポイント43ポイント  (6子コメント)

Does this factor for RES expandos? You might get slanted data for image submissions

[–]Drunken_Economist 27ポイント28ポイント  (4子コメント)

It doesn't, this is just for actual clicks. We've gotten pretty good at accounting for RES in our analyses, though :)

[–]JonnyRobbie 7ポイント8ポイント  (1子コメント)

And Imagus and other image-hover extensions?

[–]Drunken_Economist 7ポイント8ポイント  (0子コメント)

Samsies. This iteration is only for actual clicks that take a user outside of reddit, and only from frontpage/all/subreddit listing pages on desktop

[–]773cf 1ポイント2ポイント  (1子コメント)

How can you differentiate between a click and a RES expansion? I didn`t know that was possible.

[–]format120 2ポイント3ポイント  (0子コメント)

The code behind clicking the title is different from the RES code.

[–]NotANestleShill 2ポイント3ポイント  (0子コメント)

that's what I was thinking. Also videos, tweets, and everything in between.

[–]kardos 28ポイント29ポイント  (4子コメント)

I'm a bit late adding a comment here, but the solution here is simple: make it opt-out so you can appease those who don't want their off-site clicks in your database. Those who don't care won't turn it off, those who do care will, and you won't take a hit on the "creepy" meter.

[–]jcbolduc 19ポイント20ポイント  (3子コメント)

Or better yet, with any such change really, make it opt-in. I know I right-click most links here because tabbed browsing is awesome, but I'm thinking I might start clicking random links now because I don't trust Reddit admins in the slightest based on past behaviour.

Sorry guys/gals, but you suck, hard.

[–]xfile345 21ポイント22ポイント  (12子コメント)

Everyone's talking about right-clicking and copying URLs.... But what happens if you right-click > "open in new tab". I do this very often, and this doesn't register an onClick, which is how I assume you're going to be tracking information (as it currently does for the "last viewed" link--right?).

I just don't want to get some kind of flag on my account for never clicking links, but voting on stuff when I am, in fact, clicking links. Not that you're going to be flagging accounts for abuse with this data, but you know... just in case.

[–]Drunken_Economist 10ポイント11ポイント  (3子コメント)

You're correct, good eye. This doesn't capture right-clicks (which is also how I browse).

Don't worry, we aren't doing anything dumb like ignoring comments and votes from users without click events. It's more for getting baselines to inform product decisions

[–]vorpib 28ポイント29ポイント  (0子コメント)

Don't worry, we aren't doing anything dumb

The entire idea contradicts this statement

[–]bobjrsenior 4ポイント5ポイント  (1子コメント)

This doesn't capture right-clicks (which is also how I browse).

Does this include middle clicks as well?

[–]xfile345 7ポイント8ポイント  (0子コメント)

Middle-clicks appear to be captured. You can usually test things like this in your inbox. Items are marked as read when they are clicked, so you can "click" in various ways to test if it's capturing your click or not.

[–]reslez 7ポイント8ポイント  (2子コメント)

1) What if javascript is turned off?

2) I read reddit on multiple machines, not always logged in. And I frequently upvote stories I've already read but don't click on them again because... already read it. I don't want some nosy reddit autocrat/moderator making judgments about my upvote because I didn't click in the prescribed way.

3) Data is dumb. It's flawed and doesn't tell people what they think it does. I can't wait for judgy mods to start banning people or make snide comments about people who don't read the articles when they theymselves are too dumb to understand the flaws in the collection method.

[–]Pokechu22 3ポイント4ポイント  (0子コメント)

Mods will not be able to see the per-user data. We cannot see your votes (unless you enable it in your preference), so I think it's unlikely that we will be able to see the raw view data anyways.

However, if there are cases where it seems like something is amiss, mods might message the admins and ask them to look into it. I have done this a few times with regular the existing system (before link tracking); usually it's when a piece of spam that was removed automatically still gets upvoted a bunch and commented on. In some cases it has been vote manipulation by spammers; in other cases it has been more benign things like an article that was shared elsewhere (or someone getting redirected when they were resubmitting). Additional data will help diagnose cases like that better, in my opinion. (And before you get on me about reporting things like that, I've only needed to do it a few times and usually they were pretty obvious cases)

That said, you aren't supposed to vote on the same link twice from different accounts. You haven't said that you are, but you should be aware of that.

[–]Ekrof 13ポイント14ポイント  (4子コメント)

Could this be used for better subreddit stats? Something like referrals from inside reddit would be very useful.

[–]TonyQuark 5ポイント6ポイント  (0子コメント)

That would be great a great tool in detecting incoming brigades.

[–]Drunken_Economist[A] 4ポイント5ポイント  (2子コメント)

Right now, this change only collects outbound clicks (as in clicks that leave reddit), so it wouldn't be able to display referrals from inside reddit.

[–]MannoSlimmins 1ポイント2ポイント  (0子コメント)

Any changes you can talk about coming to the subreddit traffic/stats page?

I don't think that's seen an update since the feature was launched

[–]LuciousLisa 36ポイント37ポイント  (0子コメント)

Fuck this. This might actually lead me away from Reddit altogether. Privacy > entertainment.

[–]dasio123 91ポイント92ポイント  (7子コメント)

Drop that idea guys. All the three reasons are bullshit. You don't need to know the difference between number of visits and votes. You don't need to know how many people click on spam links - and there's nothing you can do about it after it happens either. You don't need to research users' behavior.

Every single organization, government and site operator introducing mass surveillance always says it's for good. "It's just so we better understand our customers". "It will help us improve the site". "It will allow us to find out how to better deliver our services". No, it won't. No one's buying that bullshit. Stop lying to us.

[–]localhorst 29ポイント30ポイント  (0子コメント)

No, it won't.

You just don’t understand! /u/Drunken_Economist says “It's more for getting baselines to inform product decisions” [1]! Which makes me wonder if (s)he is serious about the user name.

Your comment is probably the most reasonable one in this whole thread.

[1] https://www.reddit.com/r/changelog/comments/49jjb7/reddit_change_click_events_on_outbound_links/d0t1m77

EDIT: footnote

[–]emergent_properties 11ポイント12ポイント  (0子コメント)

Don't worry, the problem is just a PR issue. /s

Don't call it spyware, call it 'telemetry'.

Don't call it surveillance, call it "customer experience improvement monitoring program".

"For your safety" too, why not? Say something about there are bad, evil links that malware hides behind.

Eh, I just want honesty.

"It's profitable to track you. Therefore, we will track you."

[–]xiongchiamiov 24ポイント25ポイント  (4子コメント)

I'm a heavy privacy advocate and unsure of how I feel about this change, but if you think that sort of information isn't incredibly useful for development then you've never worked on a reasonably large web product.

Trying to make product decisions blind is a crapshoot, and nobody likes the results.

[–]dasio123 13ポイント14ポイント  (3子コメント)

I can't name one single website, or any other aspect of really anything, that got better off innecessary collection of information on users. Everytime I read about some major website (Facebook is the most obvious example) introducing some new form of spying on users, they always say "Come one guys, we will use this to make our service better! Just wait and try out yourselves how fun it will be from now on!". Only after they finally introduce this form of spying to the site, those magic changes that were supposed to make everyone happy never appear for some reason. And if some changes actually do appear, they're either cosmetic, or unnoticeable to regular users at all. In some heavy, controversial cases where people protest about surveillance, developers will usually give them some made-up statistics proving positive impact, or just distract them with some farmville type of game, or any other time-consuming, but completely useless (and even potentially harmful) feature and say "It was all possible only thanks to our spying on your diet, my friend". And they never give users choice to protect their privacy at the cost of disabling an anyway-useless feature.

I'm not saying it's reddit's admin's goal. Though perhaps it is. But even if their intentions are honest, we will not benefit from it anyway. No one ever has - except data dealers. Give me one example, where users of a site had any benefit from being spied on. Protip: you can't. Learn from history - if something had never worked, it will never work.

And how can reddit improve anyway? I mean, it's 10 years fucking old and it's already nearly perfect! There's almost nothing to improve here guys. This site already fulfills it's purpose, and there's not much more we would need here. The only purpose of further development should be improving security and protecting users' privacy - spying on them will never help.

[–]xiongchiamiov 19ポイント20ポイント  (2子コメント)

You are unlikely to see many of these things as a user, because most companies don't expose the data behind their product decisions.

Metrics are one of the most important thing in modern web operations. Facebook is known for automatically rolling back code changes when their systems notice anomalies in their metrics while deploying.

It's difficult for me to decide what to give you as specific examples of times that even I personally have been involved in making product decisions based off metrics, because it happens so often. Uh, ok, let's see.

At a previous job, we roughly halved our average page load time over two years. This was the result of a whole lot of little pieces of work, but many of those were informed by real user metrics (RUMs - to be contrasted with synthetic metrics that are run in controlled laboratory environments). One particular case I remember was when I spotted that users were getting really slow page load times (something around 30 seconds) on a particular guide; knowing that, we were able to do some profiling and some clever work to get it down to about a second. Often RUMs are the only way you'll ever know about performance problems that are only exposed on devices you don't have in-house or networks in other parts of the world (or inside corporate networks that do strange things).

Aside from performance data, usage metrics are consulted any time you have to decide what features stay and what get killed. A number of times the various dev teams I've been on have removed rarely-used features, clearing up the UI, removing security vulnerabilities, reducing the amount of time it takes to work on more-used features, or allowing the development of some new incompatible feature that solves a problem for hundreds or thousands more people than the old one.

Seeing what features are used also helps to figure out how to prioritize work; maybe not many people in the office use a particular feature, but you see that 40% of your daily users use it, so you decide that's a good area to work on performance and do some user interviews to see if there are any usability issues you can fix.

Monitoring can even help security, one of your favored subjects. Security is a constantly evolving field, and when making decisions like dropping SSLv3 or RC4 support in your HTTPS layer, you have to know how many of your users support the newer options, or in the case of RC4, have client-side protections against BEAST.

[–]dasio123 8ポイント9ポイント  (1子コメント)

A great argument, which enlightened me on some aspects of web development. However, I still don't understand what kind of useful information would reddit devs get from the number of clicks on external links. You provided examples on how RUMs may help decide which feature to leave and which to kill - but reddit won't remove the feature of clicking on external links, because clicking external links is what this whole site is about.

Also, my concerns are primarily with the three reasons for this feature provided in OP: 1. Number of votes vs. number of clicks: I can't fathom (could someone possibly enlighten me?) how information on that particular part of users' behavior would help. I mean, what, is reddit going to remove votes (since they're not going to remove linking feature)? That's okay with me, I'm an anti-fan of vote system, but there are other ways to determine whether this is necessary. Also, what if it turns out that number of downvotes is higher than number of clicks (which suggests abuse) - are users going to get banned? If so, what will be the exact criteria to get banned? What if some people downvote without clicking, because they already knew the content of the link? 2. Spam: this reason is a complete bullshit for me. Every subreddit is moderated by it's creator + mods the creator chooses. Users are able to report spam to those mods. If reddit devs want to automate the process of banning spam accounts from the whole reddit, or improve the feature by creating a blacklist of sites that are often linked by spam bots, or really any other way to fight spam they would think of, it is possible to do it by collecting information on accounts banned/posts removed from subs for spam, which does not include spying on users - only collecting the information on final decisions of subs' mods. 3. General stats: how will reddit devs use information on how many times an article is read and voted upon? Some users vote and some do not. Some users even vote without reading and some do not. There's no way to fight it.

My primary argument is that all the concerns listed in OP may be solved through other means than spying on users. Also, OP did not (at least IMO) provide a comprehensive list of reasons for this feature and possible uses that would allow us get a grasp of what it really means to us and reddit - and no one expects that, because these are complicated matters, I think. But what I know is the more information site admins have on their users, the more power over them they have - even collection of the smalles pieces of seemingly harmless information always gives a number of opportunities to abuse. And the last thing - privacy oriented users always lose in these cases, because they are never allowed to choose more privacy for less features.

[–]slccsoccer28 1ポイント2ポイント  (0子コメント)

I still don't understand what kind of useful information would reddit devs get from the number of clicks on external links.

As someone who also does web development, I feel compelled to chime in.

So Reddit already collects a bunch of information: self-post views, page views (i.e. page #3,4,5 of X sub), votes, comments, etc. These are all pretty much natural things given the domain of Reddit (i.e. for Reddit to work, you have to generate this data).

Outbound links are one thing that websites can't just generate on the server from some action (so they need to pass through a redirect). In the end collecting outbound links is no further a privacy invasion than all of the other data that's naturally collected as part of running a site like this.

This leaves the big question: what the hell is this data useful for?

Here are a couple examples:

  • Staleness - This has been a big issue on Reddit lately - stale posts, post that have been around for too long and you don't get anything new. Likewise, over compensating for staleness is an issue - if you "derank" content to quickly, people will miss things and you'll run into the issue Facebook has (where you can never find a post again).

    Collecting outbound links provides some awesome insight into how long it takes for a section of content to get stale and helps Reddit adjust how quickly things are refreshed.

    For example, if Reddit finds that X% clicks on a link occur within Y amount of time, they can make accurate adjustments to the algorithms that power the site.

  • Spam - Reddit has long used votes as a way of preventing spam. By adding outbound links, it can become easier to identify people who are trying to spam Reddit

  • Ranking - Everybody knows that you don't vote on everything you view on Reddit. Tracking outbound clicks can help Reddit understand how popular links truly are and provide other criteria than votes and time to calculate "hotness". A great example of this might be adjusting how quickly something falls of the front-page based on how many clicks it's receiving.

    In other words, A and B were posted at the same time and have the same number of votes. A is receiving 100 clicks per hour and B is receiving 1000 clicks per hour. C got posted more recently and is receiving 200 clicks per hour. Instead of kicking both A and B off, to make room for C - B remains on since it has a lot of votes and is still being actively views by lots of people.

[–]TheGrammarBolshevik 9ポイント10ポイント  (3子コメント)

Specifically, we've added some logic to allow our event tracking to be accessible for only a certain amount of time to combat its possible use for spam.

I don't follow. Why would spammers have access to this at all?

[–]umbrae[S] 7ポイント8ポイント  (2子コメント)

Spammers might use the "out.reddit.com" link that is generated for spamming, so we want to make sure that's not a good avenue for them. (This is known as an open redirect vulnerability).

[–]markevens 18ポイント19ポイント  (2子コメント)

How long before you start selling this data?

[–]faredodger 7ポイント8ポイント  (0子コメント)

This is not a "small change" as you've put it, but a huge privacy invasion on your part. This should be at least opt-out.

Sorry, I find it hard to believe that Reddit isn't going to monetize this kind of data sooner or later. You might be personally opposed to selling user data, but one change in management is enough to topple the current privacy policy. And since the data is already stored: well, tough luck. Gotta make money somehow, right?

Apart from that: How about the very real threat of data theft? How about Court Orders or National Security Letters? Would you be willing to sell out, let's say, members of the LBGT community just because it's illegal in their country?

And why do you announce this significant change in a relatively obscure subreddit and not on the blog?

[–]adeadhead 44ポイント45ポイント  (24子コメント)

Yay data!

[–]Drunken_Economist 8ポイント9ポイント  (16子コメント)

I'm pretty pumped to be able to build actual insight out of this. I think the biggest quick win will be in gauging user impact of spam — we'll know how many users clicked through on spam links

[–]adeadhead 12ポイント13ポイント  (5子コメント)

The other day I was looking for a stream of a political debate, using not terribly generic terms and two of the front page google results were reddit SEO spam linking to subreddits with spam css, it might also be worth checking those out(if possible), they're a pretty big part of how spam is starting to work here.

[–]Drunken_Economist 7ポイント8ポイント  (1子コメント)

Yeah, it's a known tactic. We're coming up with good general solutions instead of playing whack a mole. It takes a bit, but the result is worth it

[–]DublinBen 1ポイント2ポイント  (2子コメント)

This isn't really on-topic, but in /r/politics we usually have information for each of the debates. If we aren't covering it with a live thread, we at least link to reseources on where to watch it.

[–]adeadhead 5ポイント6ポイント  (1子コメント)

What if I told you I was one of your Co mods

[–]DublinBen 1ポイント2ポイント  (0子コメント)

Haha, I didn't even read your username. I rarely take that into consideration outside of closed subreddits.

[–]geraldo42 4ポイント5ポイント  (0子コメント)

we'll know how many users clicked through on spam links

I suspect the answer will be a metric fuckton. It's inexplicable how much traffic obvious spam links manage to generate but I guess if it wasn't effective they wouldn't bother to spam in the first place.

[–]allthefoxes 4ポイント5ポイント  (0子コメント)

Wait this isn't a shitpost

[–][削除されました]  (13子コメント)

[deleted]

    [–]Drunken_Economist[A] 28ポイント29ポイント  (11子コメント)

    When you right-click and copy, you should get the destination URL (not the outbound click). That copy-paste ability is really important to me too — I hate those ugly google links

    [–]kylegetsspam 5ポイント6ポイント  (2子コメント)

    Then this is to be tied to Google Analytics or some other JS tracking library? If so it's gonna be blocked by uBlock Origin, Ghostery, etc.

    [–]Drunken_Economist 10ポイント11ポイント  (1子コメント)

    No, this is fully first-party. We don't want GA/etc or other third parties to have that sort of data

    [–]arebokert 20ポイント21ポイント  (0子コメント)

    I don't want you to have that sort of data.

    [–]eduardog3000 2ポイント3ポイント  (0子コメント)

    Because it's impossible to track right clicks...

    [–]ElusiveGuy 2ポイント3ポイント  (2子コメント)

    This is actually still a problem if I drag-drop links.

    Part of my flow is to drag links into chat windows if I want to share them. Now I'm getting the ugly redirect link (which you also say will expire, making it worse).

    [–]Drunken_Economist 1ポイント2ポイント  (1子コメント)

    Does it? What browser?

    [–]ElusiveGuy 2ポイント3ポイント  (0子コメント)

    Firefox 45, IE11, Chrome 49.

    1. Must be logged in
    2. Go to reddit.com homepage
    3. Drag a link into the search box on the right

    Normally I start dragging, alt+tab to a chat window, and drop it in there. But this has the same effect.

    (I do have RES installed on Firefox but since it repros on other browsers I don't think that's related.)

    Edit: Might be significant that I'm on Windows 7. Dragging might be partially an OS thing.

    [–]allthefoxes 2ポイント3ポイント  (1子コメント)

    I;ve pasted those super long google links in slack way too many times

    [–]j0be 5ポイント6ポイント  (0子コメント)

    I haven't looked at the changeset yet, but it could be a separate Ajax request so it doesn't manipulate the url at all. (I hope this is how it was done)

    [–]Nakedpuzzlebasement 5ポイント6ポイント  (0子コメント)

    Give us a way to opt out of this bullshit.

    [–]protestor 4ポイント5ポイント  (0子コメント)

    Why isn't there an opt-out in the "privacy options" in the preferences?

    [–]armedmonkey 4ポイント5ポイント  (0子コメント)

    Are you going to provide an opt-out, or are we going to start seeing a big market for browser extensions to bypass reddit surveillance?

    I'm not even kidding.

    [–]Turtl3-1337 5ポイント6ポイント  (0子コメント)

    Can we opt-out.

    [–]timschwartz 7ポイント8ポイント  (0子コメント)

    I can't believe Reddit admins think this is acceptable.

    [–][削除されました]  (5子コメント)

    [deleted]

      [–]firstconfluence 5ポイント6ポイント  (0子コメント)

      That's the first thing I thought of, monetization...

      [–]wipeout4wh 10ポイント11ポイント  (0子コメント)

      Immediately. I would be very surprised if that wasn't the purpose of this to begin with. They're just feeding us excuses to defend their bullshit.

      [–]localhorst 8ポイント9ポイント  (0子コメント)

      As soon as someone is willing to pay for it.

      [–]FUZxxl 3ポイント4ポイント  (0子コメント)

      Please give us a way to turn off this tracking.

      [–]JohnObvious 4ポイント5ポイント  (0子コメント)

      You asked if we had any issues. Starting last night(16Mar2016) clicking or middle clicking brings up the out.reddit.com link and the link never opens. Right click, open in new tab works fine

      This on FF 44.0.2 with RES.

      [–]NotANestleShill 10ポイント11ポイント  (5子コメント)

      You better make a post on /r/dataisbeautiful when all is said and done.

      [–]teraflop 10ポイント11ポイント  (0子コメント)

      TIL Reddit wasn't doing this already.

      [–]novov 2ポイント3ポイント  (5子コメント)

      Hypothetically, would it be possible to weight votes on links based on how many people actually clicked?

      [–]umbrae[S] 3ポイント4ポイント  (4子コメント)

      Sure, it'd be possible. With many API clients that gets more tricky but it could certainly be a signal.

      [–]wipeout4wh 2ポイント3ポイント  (3子コメント)

      That's bullshit. Reddit admins should not be manipulating votes. It's one vote per person.

      [–]xiongchiamiov 7ポイント8ポイント  (1子コメント)

      It's not manipulating votes, it's changing how hot works to incorporate more than just votes and time.

      [–]phyzome 2ポイント3ポイント  (2子コメント)

      Why aren't you using the ping attribute on links? Blocked by too many browser configurations?

      [–]umbrae[S] 3ポイント4ポイント  (1子コメント)

      Yeah, it's not well supported at all. There are also HTML5 beacons, but they are also not well supported.

      [–]b3iAAoLZOH9Y265cujFh 1ポイント2ポイント  (0子コメント)

      There's also a fair few people - like me - who neuter both those mechanisms very deliberately for this exact reason. You're not inspiring confidence in your benevolence here.

      [–]meow0369 2ポイント3ポイント  (0子コメント)

      Even in the most innocent scenario this still implies they're planning on making content only appear if it reaches a certain condition. Very much like how facebook blocks certain things from appearing just because you didn't interact with them. Worst case they've got a database of user behaviour and they sell it to the highest bidder who do whatever shady stuff they want with your information which includes time you're active etc.

      [–]Werner__Herzog 5ポイント6ポイント  (1子コメント)

      Answer to 1 and 3: nobody reads the article, it is the reddit way

      [–]andytuba 4ポイント5ポイント  (0子コメント)

      If I only had analytics on how many people click RES's [l+c] button.

      [–]localhorst 9ポイント10ポイント  (12子コメント)

      Are there already browser extensions removing this privacy invasion?

      [–]wipeout4wh 18ポイント19ポイント  (11子コメント)

      // ==UserScript==
      // @name Fuck Reddit
      // @description Probably removes Reddit spying
      // @match *://*.reddit.com/*
      // @run-at document-end
      // ==/UserScript==
      
      (function() {
          "use strict";
      
          $(".outbound").attr("data-outbound-url", null);
          $(".outbound").attr("data-href-url", null);
          $(".outbound").removeClass("outbound");
      })();
      

      [–]molo1134 3ポイント4ポイント  (6子コメント)

      Thank you! It works! Greasemonkey to the rescue!

      [–]felix10888 1ポイント2ポイント  (5子コメント)

      How do know it works? What do you use to test it?

      [–]molo1134 6ポイント7ポイント  (4子コメント)

      I set ublock to block out.reddit.com. Links were not working until I added this greasemonkey script.

      [–]felix10888 1ポイント2ポイント  (3子コメント)

      I just added the greasemonkey script. How are you setting uBlock exactly?

      [–]molo1134 5ポイント6ポイント  (2子コメント)

      I have these in a custom filter:

      ||buttons.reddit.com^
      ||reddit.com/static/button/*
      ||out.reddit.com
      ||events.redditmedia.com
      

      [–]felix10888 2ポイント3ポイント  (1子コメント)

      Something to cut down on the spying around here.

      I appreciate that, thanks.

      [–]IceBreak 1ポイント2ポイント  (0子コメント)

      Any plans to add traffic data (for mods at least) of Wiki pages and/or general individual posts down the line?

      [–]jimbolla 1ポイント2ポイント  (0子コメント)

      I think it would be useful to track how often people go to the comments before and/or after the article as well. Since it was already mentioned that reddit can already track self posts, I expect you already have that data, just needs to be collated with the external site data.

      [–]live4lifelegit 1ポイント2ポイント  (0子コメント)

      Will we (the user)be able to get this data like the comment data

      [–]zephroth 1ポイント2ポイント  (0子コメント)

      Sounds like im going to start blocking cookies and tracking from reddit as well as accessing it from a throwaway and through a VPN. you guys are creating a huge privacy issue here.

      [–]SergejButkovic 1ポイント2ポイント  (0子コメント)

      Outbound links are now stalling on trying to load the "out.reddit.com" redirect. I just tried loading the same link via clicking on Reddit and direct link a few times and direct-link was magnitudes faster.

      Privacy concerns aside, the outbound redirect is a massive performance and quality-of-life issue. Seconds of delay on every click is VERY noticeable.

      [–]DoctorFuckingMario 1ポイント2ポイント  (1子コメント)

      Hooray, something the community hates yet the admins insist on adding because fuck us.

      [–]flapanther33781 1ポイント2ポイント  (0子コメント)

      Vote speed calculation: It's interesting to think about the delta between when a user clicks on a link and when they vote on it. (For example, an article vs an image). Previously we wouldn't have a good way of knowing how this happens.

      I - and any other possible users like me - may be throwing a wrench into your plans.

      I have my preferences set up to hide threads I've upvoted or downvoted. As a force of habit what I usually do is go down the front page opening 10+ tabs at a time. I upvote, right-click, hit t to open in a new tab, and move down the page. After I've looked at a tab I close it, the other pages load as I browse. (This may be typical for some older internet users ... it's a habit formed back in the dial up days when page load time took forever. It was right-click and open in a new window back then, but the concept is still the same.) When all tabs are closed I refresh the front page and repeat.

      Anyway, I upvote a split second before opening every link, and I almost never downvote. I figure my vote is pretty much worthless. It's already on the front page.

      [–]remog 3ポイント4ポイント  (8子コメント)

      I love how people are getting up in arms over this.

      As if your privacy truly matters on a private entity's website. This is just like any other website. The website owners have every right to know what users are doing on THEIR property.

      It would be like letting someone into my house, or B&M business and then them telling me that I don't have the right to know what they are doing on my property.

      It doesn't work like that, Frankly, ff you don't like it don't use the service.

      I think it's good that Reddit is announcing it's doing this, mind you. But it's simply informational, not asking permission.

      I think Reddit will do what it can, within reason to make sure the data is not used nefariously, but we can't trust that, and neither should we. If some users can't come to terms with that, then it should be a decision they have to make to continue using the service.

      [–]appropriate-username 11ポイント12ポイント  (2子コメント)

      Lol you're missing the point. People should complain when any website adds measures that reduce privacy because even though websites can do that, it makes the internet as a whole worse.

      [–]Obliterous 2ポイント3ポイント  (3子コメント)

      100% this. Reddit owns the servers and we all basically agree to this when we set up our account and agreed to the most recent TOS update.

      If someone at reddit actually cares how many porn links I click on, more power to them.

      [–]remog 3ポイント4ポイント  (2子コメント)

      How many porn links DO you click on... for science.

      [–]Obliterous 1ポイント2ポイント  (1子コメント)

      ... Enough that I built my own Multi to organize them.

      [–]remog 2ポイント3ポイント  (0子コメント)

      Well then... carry on.

      [–]ProGamerGov 3ポイント4ポイント  (0子コメント)

      Give me a way to disable this. I don't like this, and want it fucking gone from my account.

      [–]JDGumby 3ポイント4ポイント  (3子コメント)

      I guess it's time to get used to right-clicking links to copy them - and then probably edit them to get rid of the tracking crap, if you alter the URL like Google does for its top results. :/

      [–]evilnight 2ポイント3ポイント  (0子コメント)

      Vote speed calculation

      click to vote ratio

      Oh my. Are you actually going to try to normalize content?! I figured this would be one of those impossibly hard to code changes that would never make it in. Privacy concerns aside, this has huge implications for raising the IQ of the content on this website. The undisputed reign of images, clickbait titles, and name recognition will finally come to an end.

      I don't think there is any better change you could possibly make to this website. Kudos on tackling one of reddit's true core problems, I hope it works out. If you get this right you're going to be well ahead of future competition. Atko didn't think it could be done on Voat and now you're beta testing this on reddit.

      I may take back some of the nasty comments I've made about reddit's code in the past. :P