Tools for Working with Data

January 27, 2016 9:27 AM

Data Driven Journalism maintains a list of tools for working with data. Many of them are free to use or open source.

Highlights include:

DataBasic: currently a suite of three tools that analyze text, summarize data from CSV files, and compare text files.

Overview: a tool for analyzing large collections of documents. Supports automatic hierarchical categorization based on content, coding and tagging of documents, and advanced searching.

Import.io: a tool for scraping data from web pages (previously)

Bonus Link: Plot.ly: Online plotting and visualization

posted by jedicus (7 comments total)

You can't mention import.io without also talking about Open Refine. I find both of these tools work great together. Here's a neat tutorial (I don't use the fusion tables stuff personally).
posted by bonehead at 9:48 AM on January 27, 2016 [6 favorites]

Related: Data Science at the Command Line.
posted by brennen at 9:51 AM on January 27, 2016 [4 favorites]

Surely all you need is Excel.

[/Poe's law]
posted by clawsoon at 10:08 AM on January 27, 2016 [1 favorite]

https://github.com/sindresorhus/awesome - A curated list of awesome lists

(In particular the Big Data ones, and the Public Datasets one)
posted by DigDoug at 10:14 AM on January 27, 2016 [6 favorites]

OOOOOooooooOOOOOOOOOO
posted by Young Kullervo at 10:22 AM on January 27, 2016

It seems like this post is up there in terms of favorites/comments. It would be awesome to have a dataset to work with to create some visualizations around metafilter posts, users, tags, favorites, etc.
posted by exit at 7:36 PM on January 28, 2016

It would be awesome to have a dataset to work with to create some visualizations around metafilter posts, users, tags, favorites, etc.

Such a dataset exists: the MetaFilter Infodump, which is regularly updated.
posted by jedicus at 8:05 PM on January 28, 2016 [1 favorite]