background preloader

'Scrapers' Dig Deep for Data on the Web

'Scrapers' Dig Deep for Data on the Web
Related:  online transparency and privacy

Negotiating the Freelance Economy Journalism in the Age of Data In the words of Terrell Owens, get your popcorn ready, because this video (below) is awesome. During his Knight Journalism fellowship at Stanford, Geoff McGhee interviewed visualization trendsetters on how they deal and what they do with data in Journalism in the Age of Data: Journalists are coping with the rising information flood by borrowing data visualization techniques from computer scientists, researchers and artists. Martin Wattenberg and Fernanda Viègas kick things off with some of the work they did with IBM. Basically, all the repeat offenders here on FlowingData are in this video talking about what they do best. I also really like how one person will talk about his or her project, and then the video cuts to another expert saying what they think of said project. The video is on the long-ish side at a little over 50 minutes, but it's totally worth it, so if you can't watch it now, I highly recommend you bookmark for later. [datajournalism | Thanks, Josh]

Thinking Outside the Box: ConsideringTransparency, Anonymity, andPseudonymity as Overall Solutions tothe Problems of Information המרכז למשפט וטכנולוגיה הינו מרכז מחקר בפקולטה למשפטים באוניברסיטת חיפה. תכלית היא קידום פעילות מחקרית בתחומי משפט וטכנולוגיה ובנושא קניין רוחני. מקדם דיאלוג בין אקדמאיים, חוקרים, קובעי מדיניות ואנשי עסקים, על מנת לפתח את התשתית המדעית הדרושה לשם עיצוב מדיניות משפטית בנושאים הנוגעים לטכנולוגיות חדשות. המרכז עורך סדנאות וכנסים בנושאים שונים לשם קידום המחקר בתחום בקרב חברי סגל באוניברסיטאות, תלמידי מחקר, שופטים, עורכי דין, משפטנים, מקבלי החלטות והציבור הרחב. במרכז למשפט וטכנולוגיה מגוון רחב של קורסים וסמינרים בקניין רוחני ובדיני מידע, במסלולי התואר ראשון, התואר השני והדוקטורט. המרכז נהנה משיתוף פעולה עם שני מרכזים גדולים באוניברסיטת חיפה המתמחים במחקר רב תחומי בסביבת המידע: מכון קיסריה למחקר אינטרדיסציפלינרי במדעי המחשב והמרכז לחקר האדם בחברת המידע.

LRB · Slavoj Žižek · Good Manners in the Age of WikiLeaks In one of the diplomatic cables released by WikiLeaks Putin and Medvedev are compared to Batman and Robin. It’s a useful analogy: isn’t Julian Assange, WikiLeaks’s organiser, a real-life counterpart to the Joker in Christopher Nolan’s The Dark Knight? In the film, the district attorney, Harvey Dent, an obsessive vigilante who is corrupted and himself commits murders, is killed by Batman. Batman and his friend police commissioner Gordon realise that the city’s morale would suffer if Dent’s murders were made public, so plot to preserve his image by holding Batman responsible for the killings. The film’s take-home message is that lying is necessary to sustain public morale: only a lie can redeem us. No wonder the only figure of truth in the film is the Joker, its supreme villain. The Joker wants to disclose the truth beneath the mask, convinced that this will destroy the social order. WikiLeaks cannot be seen in the same way. What WikiLeaks threatens is the formal functioning of power.

HILLIS'S QUESTION: WHO GETS TO KEEP SECRETS?- An EDGE Special Event NEW CLAY SHIRKY Social & Technology Network Topology Researcher; Adjunct Professor, NYU Graduate School of Interactive Telecommunications Program (ITP); Author, Cognitive Surplus Late to the conversation, but just checked in on Christmas night to find this present of a conversation gift-wrapped and sitting in my mail box. Late though I am, I'll chime in with a few things. 1. To Danny's original question, one obvious answer to "Who gets to keep secrets?" 2. 3. (3a. 4. 5. 6. Though, as Nathan noted, the leaking of the Pentagon Papers leading to that case didn't much change the prosecution of that war, it did affect the principal target of the protests of the 1960s, which was ending the draft. Wikileaks, as both an institution and as a capability, has been global from the beginning, and the additional complexity of both jurisdiction and extradition make this particular problem much much more complex than any issues, legal or practical, triggered by the Pentagon Papers. 7. 8. 9.

WikiLeaks and the Possibility of Open Diplomacy Home > Ideas > Innovations Make a Comment By Peter Singer | Project Syndicate | December 13, 2010 At Princeton University, Woodrow Wilson, who was president of the university before he became president of the United States, is never far away. His larger-than-life image looks out across the dining hall at Wilson College, where I am a fellow, and Prospect House, the dining facility for academic staff, was his family home when he led the university. So when the furor erupted over WikiLeaks' recent release of a quarter-million diplomatic cables, I was reminded of Wilson's 1918 speech in which he put forward "Fourteen Points" for a just peace to end World War I. Is this an ideal that we should take seriously? Wilson was unable to get the Treaty of Versailles to reflect his fourteen points fully, although it did include several of them, including the establishment of an association of states that proved to be the forerunner of today's United Nations. © 2010 Project Syndicate.

Paying the price for a free web We are increasingly giving away personal information on sites such as Facebook As part of a major series on the BBC about the impact of the web, producer Jo Wade has been looking at the price we pay for free information. 'Numb Fingers.' These are a few of the eclectic and sometimes disturbing internet searches made by the users of AOL, who believed they were using their computers in private. The relationship with what we think is a free and largely private web; how we unreservedly put our innermost thoughts and queries into what feels like a very private space - sometimes thoughts we wouldn't dare share with anyone or even put down in a diary, comes at a price. Turning detective In May 2006, AOL released a file containing every search made by 658,000 of their users over the previous three months. But one reporter at the New York Times was intrigued by the potential value of data like this to governments or corporations. However this gift comes at a price and in the end someone has to pay.

Facebook in Online Privacy Breach; Applications Transmitting Identifying Information Personal Details Exposed Via Biggest U.S. Websites Rapleaf and the Facebook Privacy Ruckus: Tech News ? Updated: In the analog world of J.Crew catalogs and credit card purchases, credit bureaus like Experian built profiles on most of us. In the digital world, a new kind of digital data aggregator is spreading its tentacles on the web. The latest privacy-related dust-up at Facebook, sparked by a WSJ story, might be making Facebook the target of the consumer ire, but in my opinion, the real story centers around San Francisco-based Internet information aggregation company called Rapleaf. In their story, Emily Steel and Geoffrey Fowler of WSJ write: In this case, however, the Journal found that one data-gathering firm, RapLeaf Inc., had linked Facebook user ID information obtained from apps to its own database of Internet users, which it sells. The funny part is that Rapleaf, doesn’t need any of the user ID stuff. Rapleaf’s influence on the web is only increasing. Related content from GigaOM Pro (sub req’d):

You Deleted Your Cookies? Think Again | Epicenter  More than half of the internet’s top websites use a little known capability of Adobe’s Flash plug-in to track users and store information about them, but only four of them mention the so-called Flash cookies in their privacy policies, UC Berkeley researchers reported Monday. Unlike traditional browser cookies, Flash cookies are relatively unknown to web users, and they are not controlled through the cookie privacy controls in a browser. That means even if a user thinks they have cleared their computer of tracking objects, they most likely have not. What’s even sneakier? Several services even use the surreptitious data storage to reinstate traditional cookies that a user deleted, which is called ‘re-spawning’ in homage to video games where zombies come back to life even after being “killed,” the report found. Even the showed up in the report, with researchers reporting they found a Flash cookie with the name “userId.” Tools: * Ccleaner - See Also:

Behavioral targeting Behavioral Targeting refers to a range of technologies and techniques used by online website publishers and advertisers which allows them to increase the effectiveness of their campaigns by capturing data generated by website and landing page visitors. When it is done without the knowledge of users, it may be considered a breach of browser security and illegal by many countries' privacy, data protection and consumer protection laws. When a consumer visits a web site, the pages they visit, the amount of time they view each page, the links they click on, the searches they make and the things that they interact with, allow sites to collect that data, and other factors, create a 'profile' that links to that visitor's web browser. As a result, site publishers can use this data to create defined audience segments based upon visitors that have similar profiles. Onsite Behavioral Targeting[edit] Network Behavioral Targeting[edit] Theoretical Research on Behavioral Targeting[edit] Case law[edit]

Open Up Government Data From Wired How-To Wiki Barack Obama rode into office with a high-tech, open source campaign that digitized the book on campaigning. Now, with his selection of a celebrated open data advocate as his Chief Information Officer, Obama appears serious about bringing those same principles to the executive branch's treasure trove of data. Vivek Kundra, the new CIO, comes to the White House from a similar role as the CTO of Washington, D.C., where he garnered kudos for his clear-headed approach to making data feeds from dozens of city agencies accessible. "I'm going to be working very closely with all Federal CIOs in terms of at the agency level to make sure they are advancing an agenda that embraces open government, an agenda that looks at how we could fundamentally revolutionize technology in the public sector," Kundra said. Vivek Kundra in conversation with Nicholas Thompson at the Wired Disruptive Business Conference. The future is coming: Let's help build it. The Problem The Solution: You U.S.