Skip to content

How to read a 1 GiB file into memory in R

Here is the start of a small and good discussion on how to read large data
sets into many. They appears frequently on the list, but this one seemed to
touch upon a lot of the recommended approaches:

R graph gallery

R graph gallery.

Nirmala – Buddha at the Gas Pump Interview

Nirmala – Buddha at the Gas Pump Interview.

Be compassionate

Be [compassionate], for every man is fighting a hard battle

— John Watson, in 1903

Some Lessons

To call in the statistician after the experiment is done may be no more than asking him to perform a post-mortem examination: he may be able to say what the experiment died of.
~ Sir Ronald Aylmer Fisher

The plural of anecdote is not data.
~ Roger Brinner

The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from a given body of data.
~ John Tukey

Via r-help.

ProPublica’s Guide to Mechanical Turk

ProPublica’s Guide to Mechanical Turk seems to definitely be worth a read.

Reading Codebook Files in R

Here is a great discussion about how to automatically utilize codebooks in R via r-bloggers.

Perl regex builder in emacs

  • Perl regex builder in emacs
    • Read the wiki and there are 2 options
    • Best is this
    • Roughly confirmed that is the best and newest
    • Set up an el-get for it tonight
    • Played around for while can’t get el-get to load it
    • I can’t even load it myself
      • Probably my fault
    • Posted ticket on github page here

Markdown vignettes in R

If you somehow didn’t have a reason to look into r-markdown with knitr before,
then this is yet another really good one.

Use your space appropriately

When facing a decision of how to utilize space it is sometimes easy.
Choosing between allocating land for a water purification plant vs
a donut shop might not be an easy choice but it is an obvious one.
How then do we allocate our internal or mental space?

Inside us the space is limitless. Most of the time though we don’t feel that way.
Instead there seems to be little free space, and that results in a feeling of
being overwhelmed and unable to cope with life. That is normal and all humans
experience this phenomenon.

The good news is that we are in charge of our internal landscape. Even better,
it is always with us! We can tidy it up whenever wish. We can open up more space.
Perhaps it is more like discovering it then opening it up, because it is already there.

That new space can help to accommodate new investments, like learning how to knit
for example. It may also simply be observed, and left alone. That is really
helpful for “making space” for all of the surprise trials that inevitably will
occur in life. Usually they aren’t very surprising though, given the nature of
this reality. Nonetheless, it makes everything easier when you have a lot of
room to breathe!