(This article was first published on
, and kindly contributed to
is designed for collaborating on coding projects. Nonetheless, it is also a potentially great resource for researchers to make their data publicly available. Specifically you can use it to:
store data in the cloud for future use (for free),
track changes,
make data publicly available for replication,
create a website to nicely present key information about the data,
and uniquely:
benefit from error checking by the research community.
is an example of a data set that I’ve put up on GitHub.
Taking advantage of these things through GitHub is pretty easy. In this post I’m going to give a brief overview of how to set up a GitHub data repository.
Note: I’ll assume that you have already set up your GitHub account. If you haven’t done this, see the instructions
(for set up in the command line) or
(for the Mac GUI program) or
(for the Windows GUI program).
Store Data in the Cloud
Data basically consists of two parts, the data and description files that explain what the data means and how we obtained it. Both of these things can be simple text files, easily hosted on GitHub:
Create a new repository on GitHub by clicking on the New Repository button on your GitHub home page. A repository is just a collection of files.
Have GitHub create a README.md file.
Clone your repository to your computer.
If you are using GUI GitHub, on your repository’s GitHub main page simply click the Clone to Mac or Clone to Windows buttons (depending on your operating system).
If you are using command line git.
First copy the repository’s URL. This is located on the repository’s GitHub home page near the top (it is slightly different from the page URL).
In the command line just use the git clone [URL] command. To clone the example data repository I use for this post type:
$ git clone /christophergandrud/Disproportionality_Data.git
Of course you can choose which directory on your computer to put the repository in with the cd command before running git clone.
Fill the repository with your data and description file.
Use the README.md file as the place to describe your data–e.g. where you got it from, what project you used it for, any notes. This file will be the first file people see when they visit your repository.
To format the README.md file use
Create a Data folder in the repository and save your data in it using some text format. I prefer .csv. You can upload other types of files to GitHub, but if you save it in a text-based format others can directly suggest changes and you can more easily track changes.
Commit your changes and push them to GitHub.
In GUI GitHub click on your data repository, write a short commit summary then click Commit & Sync.
In command line git first change your directory to the data repository with cd. Then add your changes with $ git add .. This adds your changed files to the ‘‘staging area’’ from where you can commit them. If you want to see what files were changed type git status -s.
Then commit the changes with:
$ git commit -m ‘a comment describing the changes’
Then push the committed changes to GitHub with:
$ git push origin master
For more information see this .
Create a cover site with . This creates a nice face for the data repository. To create the page:
Click the Admin button next to your repository’s name on its GitHub main page.
Under ‘‘GitHub Pages’’ click Automatic Page Generator. Then choose the layout you like, add a
if you like, and publish the page.
Track Changes
GitHub will now track every change you make to all files in the data repository each time you commit the changes. The GitHub website and GUI program have a nice interface for seeing these changes.
Replication Website
Once you set up the page described in Step 5, other researchers can easily download the whole data repository either as a .tar.gz file or .zip. They can also go through your main page to the GitHub repository.Specific data files can be directly downloaded into R with the foreign and RCurl packages (and textConnection from the base package). To download my example data into R just type:
library(RCurl)
library(foreign)
url &- "/christophergandrud/Disproportionality_Data/master/Disproportionality.csv"
disproportionality.data &- getURL(url)
disproportionality.data &- read.csv(textConnection(disproportionality.data))
Note: make sure you copy the file’s raw GitHub URL.
You can use this to directly load GitHub based data into your Sweave or knitr file for direct replication.
Improve your data through community error checking
GitHub has really made open source coding projects much easier. Anybody can view a project’s entire code and suggest improvements. This is done with a pull request. If the owner of the project’s repository likes the changes they can accept the request. Researchers can use this same function to suggest changes to a data set. If other researchers notice an error in a data set they can suggest a change with a pull request. The owner of the data set can then decide whether or not to accept the change. Hosting data on GitHub and using pull requests allows data to benefit the kind of community led error checking that has been common on wikis and open source coding projects for awhile.
Git Resources
: a free book on how to use command line git.
: another good reference for command line git.
: GitHub’s reference pages.
To leave a comment for the author, please follow the link and comment on their blog: .
on topics such as: , , visualization (, , , ), programming (, , , , , , , ) statistics (, , , ) and more...
If you got this far, why not subscribe for updates from the site?
Choose your flavor: , , , or ...html - GitHub Organization Pages without named repository - Stack Overflow
to customize your list.
Stack Overflow is a community of 4.7 million programmers, just like you, helping each other.
J it only takes a minute:
Join the Stack Overflow community to:
Ask programming questions
Answer and help your peers
Get recognized for your expertise
Is it possible to create a website for a GitHub Organization (using GitHub Pages) without creating a repository with the same name?
As an example, for the organization CompPyrol, I created a repository that has the same name as the organization as comppyrol.github.io.
The html and css files for the website are located in this repository.
So the website for the organization is located at http://comppyrol.github.io.
This works but I was hoping to use GitHub pages for an organization without having to create a repository just for the website.
I know you can create an orphaned branch gh-pages for the web files but that seems to be for an individual repository or project, not for an entire organization page.
1,85611950
This is not possible. GitHub's
is quite clear:
User & Organization Pages
User & Organization Pages live in a special repository dedicated to GitHub Pages files. You will need to name this repository with the
account name, e.g.
You must use the username/username.github.io naming scheme.
Content from the master branch will be used to build and publish your GitHub Pages site.
GitHub Pages used to be served as subdomains of github.com, but . Some repositories are still set up using the old naming, but are now hosted on the new domain:
Changes to GitHub repositories:
User Pages repositories may now be named using the new username/username.github.io convention or the older username/ convention.
Existing User Pages repositories named like username/ do not need to be renamed and will continue to be published indefinitely.
If both a username.github.io and a
repository exists, the username.github.io version wins.
23.8k114550
Your Answer
Sign up or
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Post as a guest
By posting your answer, you agree to the
Not the answer you're looking for?
Browse other questions tagged
Stack Overflow works best with JavaScript enabledGitHub Help
[[#entries]]
[[/entries]]
Common Issues}