ReadWriteWeb

Confirmed: Twitter is Saving All Your Tweets, After All

Written by Marshall Kirkpatrick / September 25, 2009 1:05 PM / 23 Comments

Forest fires in California, the plane landing on the Hudson river, the Mumbai hotel attacks - these historical events and many more have been recorded by everyday people on the ground, using Twitter. The historic record may be much, much richer as a result - but you can't access it through search.twitter.com right now.

Many people have worried that the inaccessibility of historical Twitter search results might mean that the messages weren't being saved at all. Company co-founder Biz Stone told us otherwise by email today, though. Twitter is in fact saving all the tweets. You just can't access them through search "right now."

We wrote to Twitter to inquire about the company's stated plans to scrub forthcoming geolocation data from messages after 14 days. That plan is said to be aimed at avoiding subpoenas, though the publishing of the location data at all is opt-in in the first place.

Scrubbed geolocation data after two weeks and no way to access historical information at all? That sounded like a pretty bum deal for a world-changing new communication platform. So we emailed to ask.

This was the reply we received from Biz Stone: "We definitely save all the tweets although you're right in noting that our search focuses more on newer content right now. And yes, the plan is to drop the coordinates after 14 days."

There you go. Now that Twitter is putting $100 million more into the bank, it would be great to see some of those resources dedicated to making information retrieval on the service a first class function. The future would be thankful.


Comments

Subscribe to comments for this post OR Subscribe to comments for all ReadWriteWeb posts

  1. They save 'all tweets' from a user?

    Then why is it the cutoff for my account is at 6500 or something? I can't get access to old tweets when I started a couple of years ago.

    If they 'save' them, why can't we access them?

    Posted by: petra | September 25, 2009 1:27 PM



  2. That's good to know that they'll restrict access to location based services.

    Also, regarding saving all a user's tweets, they had a blog post about it some time ago, but this was the only thing I could find.

    http://apiwiki.twitter.com/Things-Every-Developer-Should-Know

    6) There are pagination limits Rest API Limit

    Clients may request up to 3,200 statuses via the page and count parameters for timeline REST API methods. Requests for more than the limit will result in a reply with a status code of 200 and an empty result in the format requested. Twitter still maintains a database of all the tweets sent by a user. However, to ensure performance of the site, this artificial limit is temporarily in place.

     Posted by: Derek Gathright Author Profile Page | September 25, 2009 1:27 PM



  3. Twitter get me amazed again.

    Posted by: Coppola | September 25, 2009 1:29 PM



  4. "If they 'save' them, why can't we access them?"

    I think the restriction is kinda BS considering we've never heard the technical reason why. The technical cost of providing logged in users access to their post-3200 tweets is negligible compared to the other services they provide. If I'm wrong on that, I'd love to hear the explanation from the company.

    I think the reason they might be holding back and not be 100% open is to retain the value for themselves and their partners -if- they choose to include that in their monetization strategy. If they decide that it isn't, then they'll just open it up. But, I want access to them, they're my messages and some of them are important.

     Posted by: Derek Gathright Author Profile Page | September 25, 2009 1:39 PM



  5. Saving all the tweets is good and fine, but why deleting the tweets by thousands of numbers?

    My friend had 16000 tweets which got slashed to just 400!

     Posted by: Chetan Bhawani Author Profile Page | September 25, 2009 1:45 PM



  6. I've used loudtweet (or loudtwitter?) to export my tweets to a blog every day. I can still access older tweets since I set it up sometime in December, 2007.

    Posted by: motownmutt Posted on FriendFeed   | September 25, 2009 1:45 PM



  7. Or you could use a service like http://tweetbackup.com to save your tweets

    Posted by: Jonas Lejon | September 25, 2009 1:51 PM



  8. As just a member of the public, I asked Twitter support on 19 May 2008 as to whether they save all my Tweets or if they were only storing a set number of the most recent ones and then going into the abyss after that.

    I got the reply "Yes, your tweets will stay there as long as you don't delete them, or delete your account."

    Posted by: Don | September 25, 2009 1:58 PM



  9. All your tweets are belong to us

    Posted by: Justin Kistner | September 25, 2009 2:01 PM



  10. I think one of the things about Twitter that appeals to a lot of people is the perception that it is ephemeral and won't come back to haunt you.

    I wonder about that, if Twitter is part of your permanent record are you as likely to speak your mind? Could twitter be breaking a contract that many users assumed was there by bringing historical search into play? Could it be that the the regular appearance of the fail whale was one of the things that signaled to people that twitter was a place where you could be safely indiscreet?

    I suspect that attempts to monetise historical search of Twitter would leave many users feeling violated. Unless they with a "You own your own past, but anyone else's cost money." sort of model.

     Posted by: Larry Price Author Profile Page | September 25, 2009 2:05 PM



  11. I worry about this. I'm amazed that I can still go back to the first email I ever received in Gmail, from June 16, 2004:

    http://flic.kr/p/72uEph

    Why is that Google can provide me with instant access to over 130K emails, but Twitter bails at 3200? Not impressed.

    I want my money back.

    Posted by: factoryjoe.com Author Profile Page | September 25, 2009 9:17 PM



  12. I think one of the things about Twitter that appeals to a lot of people is the perception that it is ephemeral and won't come back to haunt you.

    I wonder about that, if Twitter is part of your permanent record are you as likely to speak your mind? Could twitter be breaking a contract that many users assumed was there by bringing historical search into play? Could it be that the the regular appearance of the fail whale was one of the things that signaled to people that twitter was a place where you could be safely indiscreet?

    I suspect that attempts to monetise historical search of Twitter would leave many users feeling violated. Unless they with a "You own your own past, but anyone else's cost money." sort of model.

    Posted by: jeux voiture | September 26, 2009 4:31 AM



  13. This is a great thing. The word is 'accountability.' You'll be more likely to think before you tweet, which will only add value to the experience.

    RB

    Posted by: Ryan Biddulph | September 26, 2009 6:17 AM



  14. I think twitter is sitting on a goldmine of data and trying to figure out how to best capitalize on it.

    Posted by: Pocket Pussy Cat | September 26, 2009 10:14 AM



  15. @factoryjoe.com because it's a harder problem than you think.

    Posted by: Jeremy Zawodny | September 26, 2009 12:20 PM



  16. @Kistner - I love your comment ^^ but your comment is the reality that many do not realize it

    Posted by: Honey | September 26, 2009 12:34 PM



  17. Saving all tweets? But clearly not all tweets are equal in the eyes of Twitter. My account has been sandboxed for months. "mikecane" does not show up as a tweet originator in Search Twitter. Does Twitter have an answer for that?

     Posted by: Mike Cane Author Profile Page | September 26, 2009 5:37 PM



  18. I think twitter is sitting on a goldmine of data and trying to figure out how to best capitalize on it.

    Posted by: söve Author Profile Page | September 27, 2009 1:02 AM



  19. Measure twice and cut once...that should be your mode of operation on twitter.

    The bad may come back to haunt you and its the negativity aspect that is troublesome. Lawyers, Gove Agencies, enemies can capitalize on it..

    Posted by: dantanner | September 27, 2009 9:32 AM



  20. Its gotta be a pain in the ass dealing with those abnoxious feds all the fucking time...
    If it was my company, I'll delete all the tweets after a couple of days a tell the feds to go fuck themselves.

    Posted by: shadow | September 27, 2009 7:04 PM



  21. Another app out there which already lets you backup your tweets: Tweetstream. Also pulls out trends (like your TFF) and take your twitter data with you.

    (@Chetan Bhawani we've had some success uncovering lost tweets with Tweetstream. Give it a try.)

    Posted by: tweetstream | September 29, 2009 9:01 AM



  22. Social networks like facebook are gathering too much information on people allowing
    projects like the gaydar project (http://gawker.com/5364264/face.....it-project) work or
    websites like http://www.myfacebookstalker.com to get results.

    Posted by: Roy | September 29, 2009 9:31 PM



  23. Thsi is really sad, to invest such resources in this what is the point of it all? surely important feature would be to enhance the functionality oh well have retweeted this!!

    Posted by: James Albright | January 15, 2010 12:58 PM



Leave a comment

Optional: Sign in with Connect Facebook   Sign in with Twitter Twitter   Sign in with OpenID OpenID  |  

If you think Twitter is big, check out the Real-Time Web
RWW SPONSORS



FOLLOW @RWW ON TWITTER

ReadWriteWeb on Facebook



TEXT LINK ADS



RWW PARTNERS