This is a nice overview of the problem and one or two solutions.
Category: Link
How to read a 1 GiB file into memory in R
Here is the start of a small and good discussion on how to read large data
sets into many. They appears frequently on the list, but this one seemed to
touch upon a lot of the recommended approaches:
- ColByCol
- Mentions true cost of loading a 1 GiB file with
read.table
, which is much
more than 1 GiB
- Mentions true cost of loading a 1 GiB file with
- R.filesets
- Large memory and out-of-memory data in High-Performance and Parallel Computing with R
- Use a real database with SQLite or sqldf
R graph gallery
Nirmala – Buddha at the Gas Pump Interview
Be compassionate
Be [compassionate], for every man is fighting a hard battle
— John Watson, in 1903
Some Lessons
To call in the statistician after the experiment is done may be no more than asking him to perform a post-mortem examination: he may be able to say what the experiment died of.
~ Sir Ronald Aylmer Fisher
The plural of anecdote is not data.
~ Roger Brinner
The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from a given body of data.
~ John Tukey
Via r-help.
ProPublica’s Guide to Mechanical Turk
ProPublica’s Guide to Mechanical Turk seems to definitely be worth a read.
Reading Codebook Files in R
Here is a great discussion about how to automatically utilize codebooks in R via r-bloggers.
Perl regex builder in emacs
Edit a source block with its name shown in org
My preference is to rely upon heading property inheritance to define source block
names. That way, you can just do your work knowing “where” you are working and
keep it simple by not having to name everything. That was just fine until I
wrote a document where I needed to name each source block.
It gets easy to forget the source block’s name. Not the end of the world, but very nice to know.
(defun gcr/org-edit-src-code-plus-name ()
"Edit the well-described source code block.
Attribution: URL `https://lists.gnu.org/archive/html/emacs-orgmode/2014-09/msg00778.html'"
(interactive)
(let* ((eop (org-element-at-point))
(name (or (org-element-property :name (org-element-context eop))
"ॐ"))
(lang (org-element-property :language eop))
(buff-name (concat "*Org Src " name "[" lang "]*")))
(org-edit-src-code nil nil buff-name)))