diff options
Diffstat (limited to 'NEWS')
| -rw-r--r-- | NEWS | 5344 |
1 files changed, 5344 insertions, 0 deletions
@@ -0,0 +1,5344 @@ +20240222 + +New in this release: + +* No new functionality + +* Bug fixes and man page updates. + + +20240122 + +New in this release: + +* --sshlogin supports ranges: server[01-12,15] 10.0.[1-10].[2-254] + +* --plus enables {slot-1} and {seq-1} = {%}-1 and {#}-1 to count from 0. + +* env_parallel.{sh,ash,dash,bash,ksh,zsh} is now the same script. + +* Bug fixes and man page updates. + + +20231222 + +New in this release: + +* --combine-exec combines GNU Parallel with any executable. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* The first GNU Parallel video that seems to be completely AI + generated: https://www.youtube.com/watch?v=Ie8eAhlEHOg + +* GNU Parallel and “fail immediately if any fails” problem + https://antiarchitect.medium.com/gnu-parallel-and-fail-immediately-if-any-fails-problem-481ddea690ba + + +20231122 + +New in this release: + +* -a file1 -a +file2 will link file2 to file1 similar to ::::+ + +* --bar shows total time when all jobs are done. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Using GNU Parallel in bash scripts to optimize python processes + https://climate-cms.org/posts/2023-11-02-gnu-parallel.html + + +20231022 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Resume long parallel jobs + https://ginolhac.github.io/posts/2023-10-02_resume-parallel/index.html + +* Efficiency and Speed with GNU Parallel + https://dev.to/0xog_pg/efficiency-and-speed-with-gnu-parallel-loo + + +20230922 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* This CLI Tool is AMAZING | Prime Reacts + https://www.youtube.com/watch?v=ry49BZA-tgg + +* New Data Engineering Stack - GNU parallel + https://www.linkedin.com/feed/update/urn:li:activity:7100509073149743104?updateEntityUrn=urn%3Ali%3Afs_feedUpdate%3A%28V2%2Curn%3Ali%3Aactivity%3A7100509073149743104%29 + + +20230822 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* GNU Parallel, where have you been all my life? + https://alexplescan.com/posts/2023/08/20/gnu-parallel/ + +* Parallel (multithreaded) music download from Youtube + https://hrna.moe/?p=parallel-multithread-music-download + + +20230722 + +New in this release: + +* Time functions (e.g. yyyymmdd($secs) ) can now take secs since epoch as argument. + +* Bug fixes and man page updates. + + +20230622 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Run faster in the terminal with Gnu Parallel https://www.youtube.com/watch?v=fSYVYsKXWP0 + +* Building an (Evil) Android Phone Bot Army http://blog.faucher.net/2023/05/building-evil-android-phone-bot-army.html + + +20230522 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Introduction to parallel computing https://youtu.be/fvrHXV8yqU4?t=2874 + +* Script for summarizing GNU parallel joblog file https://github.com/gavinmdouglas/parallel_joblog_summary + +* How to copy a single file to multiple directories in Linux or Unix https://www.cyberciti.biz/faq/linux-unix-copy-a-file-to-multiple-directories-using-cp-command/ + +* Search in your Jupyter notebooks from the CLI, fast. https://dev.to/attilavm/search-in-your-jupyter-notebooks-from-the-cli-fast-1408 + +* Parallel Job Orchestration with GNU Parallel https://www.youtube.com/watch?v=2tVpUfND3LI + +* Optional Individual Submission 4 Job Handling 20266001 - GNU Parallel https://www.youtube.com/watch?v=eC_RPuFCcU8 + +* DOE Cross-facility Workflows Training - April 12, 2023 https://www.youtube.com/watch?v=Ke3sirM-aQQ + +* How to run MiXCR 4.x on multiple patient samples using GNU Parallel https://www.youtube.com/watch?v=OXg-WHlB_dk + + +20230422 + +New in this release: + +* --jobs evaluates expression: +3*log(55)% = ncpu*1.12 + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Running shell script in parallel + https://w3toppers.com/running-shell-script-in-parallel/ + +* Simulating climate risk scenarios for the Amazon Rainforest + https://aws.amazon.com/blogs/hpc/simulating-climate-risk-scenarios-for-the-amazon-rainforest/ + +* How To Use Your Entire CPU In Bash With Parallel + https://bash-prompt.net/guides/parallell-bash/ + +* Bash - parallel command execution + https://medium.com/linuxstories/bash-parallel-command-execution-d4bd7c7cc1d6 + +* 3 tips for faster batch post-pro + https://www.cfdengine.com/newsletter/142/ + + +20230322 + +New in this release: + +* Better support for wide characters in --latest-line. + +* Support for rsync 3.2.7. + +* Bug fixes and man page updates. + + +20230222 + +New in this release: + +* parsort: --parallel now does closer to what you expect. + +* parallel: --files0 is --files but \0 separated. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* 5 great Perl scripts to keep in your sysadmin toolbox + https://www.redhat.com/sysadmin/perl-scripts + + +20230122 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* The Best Ethical Hacking Tools of 2023 (and their basic usage) + https://www.purevpn.com/blog/the-best-hacking-tools-of-2023/#11_GNU_Parallel + +* GNU Parallel: criando atividades em paralelo com shell script + https://www.vivaolinux.com.br/artigo/GNU-Parallel-criando-atividades-em-paralelo-com-shell-script/ + + +20221222 + +New in this release: + +* --results works on more file systems (e.g. fat) + +* Joblog gives the same exit code as bash. + +News about GNU Parallel: + +* Programação Shell Linux: Paralelismo de processos com GNU parallel + https://www.youtube.com/watch?v=duheTWLIrp8 + +* Talk Python: Data Science from the Command Line + https://talkpython.fm/episodes/show/392/data-science-from-the-command-line + + +20221122 + +New in this release: + +* Support for IPv6 adresses and _ in hostnames in --sshlogin. + +* Use --total-jobs for --eta/--bar if generating jobs is slow. + +* A lot of bugs fixed in --latest-line. + +* Better support for MSYS2. + +* Better Text::CSV error messages. + +* --bar supports UTF8. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* GNU Parallel is now on Mastodon: @GNU_Parallel@hostux.social + + +20221022 + +New in this release: + +* --latest-line chops line length at terminal width. + +* Determine max command length faster on Microsoft Windows. + +News about GNU Parallel: + +* Distributed Task Processing with GNU Parallel + https://www.youtube.com/watch?v=usbMLggdMgc + +* GNU Parallel workflow for many small, independent runs + https://docs.csc.fi/support/tutorials/many/ + +* Copy a File To Multiple Directories With A Single Command on Linux + https://www.linuxfordevices.com/tutorials/linux/copy-file-to-multiple-directories-with-one-command + +* Behind The Scenes: The Power Of Simple Command Line Tools At Cloud + Scale + https://blog.gdeltproject.org/behind-the-scenes-the-power-of-simple-command-line-tools-at-cloud-scale/ + +* Run lz4 compression in parallel using GNU parallel + https://www.openguru.com/2022/09/ + +* Xargs / Parallel With Code Examples + https://www.folkstalk.com/2022/09/xargs-parallel-with-code-examples.html + +* Parallel processing on a single node with GNU Parallel + https://www3.cs.stonybrook.edu/~cse416/Section01/Slides/SeaWulfIntro_CSE416_09222022.pdf + +* Using GNU parallel painlessly -- from basics to bioinformatics job + orchestration https://www.youtube.com/watch?v=qypUdm-IE9c + + +20220922 + +New in this release: + +* --colour-failed only changes output for failing jobs. + +* Password for --sshlogin can be put in $SSHPASS. + +* Examples are moved from `man parallel` to `man parallel_examples`. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* WOMM - Works On My Machine uses GNU Parallel https://pypi.org/project/womm/ + + +20220822 + +New in this release: + +* --header 0 allows using {filename} as replacement string + +* Bug fixes and man page updates. + + +20220722 + +New in this release: + +* --colour-failed will color output red if the job fails. + +* sql: support for InfluxDB. + +* Polarhome.com is dead, so these OSs are no longer supported: AIX + HPUX IRIX Minix OPENSTEP OpenIndiana OpenServer QNX Solaris Syllable + Tru64 Ultrix UnixWare. + +* Bug fixes and man page updates. + + +20220622 + +New in this release: + +* , can be used in --sshlogin if quoted as \, or ,, + +* --plus {/#regexp/str} replace ^regexp with str. + +* --plus {/%regexp/str} replace regexp$ with str. + +* --plus {//regexp/str} replace every regexp with str. + +* 'make install' installs bash+zsh completion files. + +* Bug fixes and man page updates. + + +20220522 + +New in this release: + +* --latest-line shows only the latest line of running jobs. + +* --color colors output in different colors per job (this obsoletes --ctag). + +* xargs compatibility: --process-slot-var foo sets $foo to jobslot-1. + +* xargs compatibility: --open-tty opens the terminal on stdin (standard input). + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Building a fault-tolerant work queue for command-line executions + with GNU Parallel https://www.jvt.me/posts/2022/04/28/shell-queue/ + +* Make your code do more, with less + https://www.blopig.com/blog/2022/05/make-your-code-do-more-with-less/ + +* W09 B IntroHPC II 20220513 gnu parallel + https://www.youtube.com/watch?v=2udvC90rIa4 + + +20220422 + +New in this release: + +* sash is no longer supported as shell. + +* --retries 0 is an alias for --retries 2147483647. + +* --shell-completion returns shell completion code. + +* --ssh-login-file reloads every second. + +* --parset is replaced with --_parset because it is only used internally. + +* sem --pipe passes STDIN (standard input) to the command. + +* Bug fixes and man page updates. + + +20220322 + +New in this release: + +* --sshlogin user:password@host is now supported by using sshpass. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Bash: GNU Parallel with Curl + https://gist.github.com/CMCDragonkai/5914e02df62137e47f32?permalink_comment_id=2617456 + +* The Pipe Operator Explained + https://medium.com/geekculture/the-pipe-operator-explained-cbd41e23775a + + +20220222 + +New in this release: + +* Encoding of remote commands has changed. This limits the length of + remote commands to less than half. It also requires $REMOTE_TMPDIR + to be writable. It makes this release beta quality. + +* Time functions hh_mm_ss() hhmmss() hh_mm() hhmm() are now available + for {= =}. + +* Many options in the man page for parallel now has 'see also' for + related options. + +* parallel_options_map.pdf is a map showing which options other + options relate to. + +* {uniq} added to --plus to only run jobs with unique values. + +* sem --fg exits with the exit code of the job. + +* Bug fixes and man page updates. + + +20220122 + +New in this release: + +* GNU Parallel turned 20 on the 2022-01-06 + https://www.gnu.org/software/parallel/20th-birthday.html + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Save Time with Modern Search Techniques + https://www.eventbrite.com/e/ohio-information-security-forum-january-2022-monthly-meeting-tickets-240632737997 + +* Bash "Fail immediately if any fails" + https://morioh.com/p/a01b883dc57c + +* Re-encoding the EmacsConf videos with FFmpeg and GNU Parallel + https://sachachua.com/blog/2021/12/re-encoding-the-emacsconf-videos-with-ffmpeg-and-gnu-parallel/ + +* Bash 平行 https://learntutorials.net/ja/bash/topic/10778/%E5%B9%B3%E8%A1%8C + + +20211222 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* The first version of Parallel will be 20 years on 2022-01-06 + +* HerrComp Intro HPC gnu parallel + https://www.youtube.com/watch?v=tcgjKWfgWQY + +* 多数のファイルを処理する場合の工夫 + https://qiita.com/toramili/items/44a770cfb9ef1edc9e26 + +* How To Install parallel on Ubuntu 20.04 + https://installati.one/ubuntu/20.04/parallel/ + +* Distributing embarrassingly parallel tasks GNU Parallel + https://ulhpc-tutorials.readthedocs.io/en/latest/sequential/gnu-parallel/ + + +20211122 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Otimizando o seu Hacking com o GNU Parallel - Mateus Buogo + https://www.youtube.com/watch?v=xIpPPZXDKGU + +* SMACK 12 - Do it faster! Simple ways to use all those cores (and + GPUs) efficiently. https://www.youtube.com/watch?v=lXDGY7NvOYk + + +20211022 + +New in this release: + +* Don't postpone output until $jobslots jobs have been started. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* How to Install GNU Parallel using Anaconda | Linux + https://www.youtube.com/watch?v=UwDNVP-L0qA + +* Install GNU Parallel from source code | Linux + https://www.youtube.com/watch?v=PIyJH4ben5o + +* Compiling GNU Parallel on CentOS-7 + https://thelinuxcluster.com/2021/10/19/compiling-gnu-parallel-on-centos-7/ + + +20210922 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* 3 Programs that will Level Up your Bash Game + https://medium.com/codex/3-programs-that-will-level-up-your-bash-game-bf14e17e2291 + +* I Summarized 100+ Command-Line Tools for Data Scientists in 15 + Minutes + https://towardsdatascience.com/i-summarized-100-command-line-tools-for-data-scientists-in-15-minutes-976def544ffe + +* Speed up Your Builds by Parallelizing + https://www.incredibuild.com/blog/speed-up-your-builds-by-parallelizing + +* Bash: GNU Parallel with Curl + https://gist.github.com/dinh/93b936a55de9a331199d6582bc2921d2 + + +20210822 + +New in this release: + +* --ctag/--ctagstring colors the tag in different colors for each job. + +* You can use unit prefixes (k, m, g, etc) with -n -N -L. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Parallelising jobs with GNU parallel + https://blog.ronin.cloud/gnu-parallel/ + +* Use multiple CPU Cores with your Linux commands - awk, sed, bzip2, + grep, wc, etc. https://cdmana.com/2021/07/20210728132344693t.html + +* How to execute commands in parallel in Linux + https://net2.com/how-to-execute-commands-in-parallel-in-linux/ + + +20210722 + +New in this release: + +* --results no longer prints the result to standard output (stdout) as + voted in + https://lists.gnu.org/archive/html/parallel/2020-12/msg00003.html + +* parset supports associative arrays in bash, ksh, zsh. + +* Online HTML is now generated by Sphinx. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Cleaning Up Scanned Documents with Open Source Tools + https://kaerumy.medium.com/cleaning-up-scanned-documents-with-open-source-tools-9d87e15305b + + +20210622 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* How to use GNU Parallel + https://techtipbits.com/linux/how-to-use-gnu-parallel/ + +* How to Speed Up Bash Scripts with Multithreading and GNU Parallel + https://adamtheautomator.com/how-to-speed-up-bash-scripts-with-multithreading-and-gnu-parallel/ + +* Use Parallel to split by line + https://madflex.de/use-parallel-to-split-by-line/ + +* Optimizing long batch processes or ETL by using buff/cache properly + II (parallelizing network operations) + http://www.elsotanillo.net/2021/06/optimizing-long-batch-processes-or-etl-by-using-buff-cache-properly-ii-parallelizing-network-operations/ + +* Parallelization 3: GNU Parallel https://www.youtube.com/watch?v=Rl06WD60afA + + +20210522 + +New in this release: + +* --plus includes {%%regexp} and {##regexp}. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Batch Calculate and Verify MD5 Checksum With GNU Parallel + https://omicx.cc/posts/2021-04-28-calculate-and-verify-md5-checksum-with-gnu-parallel/ + +* HerrComp Gnu parallel, c++11 threads 2021 04 28 + https://www.youtube.com/watch?v=wDd9F9nn0qA + +* Distributing embarrassingly parallel tasks GNU Parallel + https://ulhpc-tutorials.readthedocs.io/en/latest/sequential/gnu-parallel/ + +* Job Parallelization on Niagara + https://www.maryamdaryalal.com/post/job-parallelization-on-niagara + +* Use Parallel to split by line + https://madflex.de/use-parallel-to-split-by-line/ + +* m1 multi-core batch convert with gpu parallel + ffmpeg + https://www.youtube.com/watch?v=hAuc0YsXv6A + + +20210422 + +New in this release: + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Bioinformatics tutorials - linux and shell advanced - parallel + https://www.youtube.com/watch?v=5leL8pyl0XA + +* GNU Parallel for quick gains + https://edbennett.github.io/high-performance-python/04-gnu-parallel/index.html + +* Processing Linux Commands in Parallel + https://www.baeldung.com/linux/processing-commands-in-parallel + +* GNU parallel + https://docs-research-it.berkeley.edu/services/high-performance-computing/user-guide/running-your-jobs/gnu-parallel/ + +* GNU Parallel 활용 가이드https://genoglobe.com/kribb/gnu_parallel + +* Parallel Grep and Awk + https://www.highonscience.com/blog/2021/03/21/parallel-grep/ + +* Getting things done with shell scripting + https://doma.dev/blog/get-things-done-with-bash/ + + +20210322 + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* The very first version of Parallel dated 2002-01-06 was found in an + old backup: + + #!/usr/bin/perl + + $processes=shift; + + chomp(@jobs=<>); + for (@jobs) { + $jobnr++; + push @makefile, + (".PHONY : job$jobnr\n", + "job$jobnr :\n", + "\t$_\n"); + } + unshift @makefile, "all : ",(map { "job$_ " } 1 .. $jobnr),"\n"; + + open (MAKE, "| make -k -f - -j $processes") || die; + print MAKE @makefile; + close MAKE; + +* Introduction to GNU Parallel + https://www.youtube.com/watch?v=Kj-6JkAqw-8 + +* Using GNU Parallel with GooseSLURM + https://readthedocs.org/projects/gooseslurm/downloads/pdf/latest/#chapter.7 + +* Why GNU-parallel? + https://github.com/lijingbu/omics/blob/main/why_gnu_parallel.md + + +20210222 + +* --filter only run jobs where the filter is true. The filter can + contain replacement strings and Perl code such as: '{1} < {2}+1' + +* --template takes a text file as a template with replacement + strings. Then it replaces the replacement strings and saves it + under a new filename. + +* --plus implements {0%} {0#} replacement string for zero padded slot + and sequence. + +* Warn that you probably mean -d '\r\n' if the first 3 values end in + \r\n (DOS newline). + +* {= perlexpression =} must return the same value, if run twice on the + same input. + +* Man pages available as .rst-format. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* A short tutorial on Gnu Parallel + https://www.polarmicrobes.org/a-short-tutorial-on-gnu-parallel/ + +* 5 reasons why I love coding on Linux + https://opensource.com/article/21/2/linux-programming + +* Simple Tutorial to install & use GNU Parallel + https://medium.com/analytics-vidhya/simple-tutorial-to-install-use-gnu-parallel-79251120d618 + +* LiDO3 - first contact + https://www.lido.tu-dortmund.de/cms/de/LiDO3/LiDO3_first_contact_handout.pdf + +* Rill Stage 2-1: Ways of command-line data analysis + https://blog.jastix.biz/post/rill-stage-2-1-cli-data-analysis/ + +* Introduction to GNU Parallel + https://blog.knoldus.com/introduction-to-gnu-parallel/ + +* GNU Parallel https://www.hahwul.com/cullinan/parallel/ + + +20210122 + +* --memsuspend suspends jobs when there is little memory free. This + way you can run jobs in parallel that added up potentially will take + up more RAM than is available. + +* $PARALLEL_ARGHOSTGROUPS and the replacement string {agrp} will give + the hostgroup given on the argument when using --hostgroup. + +* Handy time functions for {= =}: yyyy_mm_dd_hh_mm_ss() + yyyy_mm_dd_hh_mm() yyyy_mm_dd() yyyymmddhhmmss() yyyymmddhhmm() + yyyymmdd() hash($str) + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Software Engineering For Scientists + https://canvas.stanford.edu/courses/133091 + +* Optional Individual Submission 4 Job Handling - GNU Parallel + https://www.youtube.com/watch?v=-tX0bFAYAxM + +* 关于gnu parallel：GnuParallel：在集群上并行化脚本，脚本将文件写入主 + 节点https://www.codenong.com/25172209/ + +* すぐ忘れてしまう、仕事で使う技 + https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c + + +20201222 + +* --pipe engine changed making --pipe alpha quality. + +* --results -.json outputs results as JSON objects on stdout (standard + output). + +* --delay 123auto will auto-adjust --delay. If jobs fail due to being + spawned too quickly, --delay will exponentially increase. + +* --plus sets {hgrp} that gives the intersection of the hostgroups of + the job and the sshlogin that the job is run on. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Best practices for accelerating data migrations using AWS Snowball + Edge + https://aws.amazon.com/blogs/storage/best-practices-for-accelerating-data-migrations-using-aws-snowball-edge/ + +* Pass the Output of a Command as an Argument for Another + https://www.baeldung.com/linux/pass-cmd-output-as-an-argument + +* Warwick RSE Drop-in - Workflow Management Part 2 - GNU Parallel + https://www.youtube.com/watch?v=t_v2Otgt87g + + +20201122 + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* https://bash-prompt.net/guides/gnu-parallel-multi-server/ + + +20201022 + +* --termseq now works for jobs running remotely. + +* parsort: Performance optimized for 64-core machines. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Juan Sierra Pons has made a testimonial: + http://www.elsotanillo.net/wp-content/uploads/GnuParallel_JuanSierraPons.mp4 + +* 「翻译」在生物信息学中使用 GNU-Parallel + https://cloud.tencent.com/developer/article/1705499 + + +20200922 + +* New CPU detection for GNU/Linux. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Aug 21, 2020 - More Unix tools + https://floki.blog/2020/08/more_unix_tools + + +20200822 + +New in this release: + +* Max command line length is changed for MacOS - making this version + beta quality for MacOS. + +* Bug fixes and man page updates. + + +20200722 + +New in this release: + +* No new functionality + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Tips for Running Jobs on your VM + https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel + +* Introduction to GNU Parallel: Parallelizing Massive Individual Tasks + https://www.youtube.com/watch?v=QSFLTEyCKvo + +* Slides for same + http://www.hpc.lsu.edu/training/weekly-materials/2020-Spring/GNUParallel_Spring_2020.pdf + +* Linux-Fu: Parallel Universe + https://hackaday.com/2020/06/29/linux-fu-parallel-universe/ + +* Resumable batch jobs with gnu parallel https://igor.io/parallel/ + +* Introducing Parallel into Shell + https://www.petelawson.com/post/parallel-in-shell/ + +* AV1 encoding parallelization with GNU Parallel + https://www.reddit.com/r/AV1/comments/fjvqp9/av1_encoding_parallelization_with_gnu_parallel/ + +* Beschleunigte Befehlsbearbeitung mit GNU Parallel + https://www.linux-community.de/ausgaben/linuxuser/2013/06/beschleunigte-befehlsbearbeitung-mit-gnu-parallel/ + + +20200622 + +New in this release: + +* No new functionality + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* GNU Parallel is used at NERSC: + https://www.nersc.gov/assets/Uploads/08-Workflows-20200616.pdf + +* Resumable batch jobs with GNU Parallel https://igor.io/parallel/ + +* Lab Meeting technical talk + https://www.slideshare.net/hoffmanlab/gnu-parallel-194030490 + +* Open Sky Software Website Credits + https://www.openskysoftware.com/site-credits.htm + +* Speed up your Python Scripts using Ubuntu and GNU Parallel + https://ecce.esri.ca/wpecce/2019/12/24/speed-up-your-python-scripts-using-ubuntu-and-gnu-parallel/ + +* Indispensable command-line tools + https://negfeedback.blogspot.com/2020/05/indispensable-command-line-tools.html + +* GNU Parallel for simulations + http://pdebuyl.be/blog/2020/gnu-parallel-for-simulations.html + +* Introduction to GNU parallel + https://bioinformaticsworkbook.org/Appendix/GNUparallel/GNU_parallel_examples.html + + +20200522 + +New in this release: + +* While running a job $PARALLEL_JOBSLOT is the jobslot of the job. It + is equal to {%} unless the job is being retried. See {%} for + details. + +* While running a job $PARALLEL_SSHLOGIN is the sshlogin line with + number of cores removed. E.g. '4//usr/bin/specialssh user@host' + becomes: '/usr/bin/specialssh user@host' + +* While running a job $PARALLEL_SSHHOST is the host part of an + sshlogin line. E.g. '4//usr/bin/specialssh user@host' becomes: + 'host' + +* --plus activates the replacement strings {slot} = $PARALLEL_JOBSLOT, + {sshlogin} = $PARALLEL_SSHLOGIN, {host} = $PARALLEL_SSHHOST + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Portable Batch System (PBS) & GNU Parallel - Running a Program + Multiple Times in Parallel + https://www.youtube.com/watch?v=6ccbWu6Befo + +* GNU Parallel przykład https://www.youtube.com/watch?v=gs_wG4Kt2G4 + +* Demo of LINUX APP - GNU PARALLEL - running multiple Gstreamer webcam + .sh scripts with only 1 command + https://www.youtube.com/watch?v=trQuA_wmWjg + + +20200422 + +This release celebrates GNU Parallel's 10 years as a GNU tool: + +> commit ed2dfb1043768154d4e7678e01e10287155fa834 +> Author: Ole Tange <ole@tange.dk> +> Date: Thu Apr 22 01:23:00 2010 +0200 +> +> Name change: Parallel is now GNU Parallel. +> Basic structure for sshlogin and sshloginfile. + +New in this release: + +* parsort makes GNU sort run faster for files with more than 1M lines. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* Several clusters have updated their documentation of GNU Parallel: + https://www.grid5000.fr/w/GNU_Parallel + https://research-it.berkeley.edu/virtual-training-running-jobs-parallel-savio + http://www.hpc.lsu.edu/training/archive/tutorials.php + +* add_pho uses GNU Parallel: https://github.com/SeedlingsBabylab/add_pho + +* GNU parallel使用笔记https://zhuanlan.zhihu.com/p/37340011 + +* Virtual Workshop: Running Jobs in Parallel on Savio + https://ais.berkeley.edu/events/virtual-workshop-running-jobs-parallel-savio/2020-04-20 + +* Free Concurrency with GNU Parallel + https://phili.pe/posts/free-concurrency-with-gnu-parallel/ + + +20200322 + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* The GNU Parallel course in Copenhagen is cancelled + https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/ + +* The GNU Parallel course in Århus is cancelled + https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/ + +* The 10 year anniversary may be cancelled, see + https://www.gnu.org/software/parallel/10-years-anniversary.html + +* Running shell commands in parallel, via GNU Parallel + https://dev.to/saveriomiroddi/running-shell-commands-in-parallel-via-gnu-parallel-3a72 + +* Faster nmap scanning with the help of GNU parallel + https://badshah.io/experiment/faster-nmap-scanning-with-the-help-of-gnu-parallel/ + + +20200222 + +* Bug fixes and man page updates. + + +20200122 + +* --blocktimeout dur - Time out for reading block when using + --pipe. If it takes longer than dur to read a full block, use the + partial block read so far. + +* Bug fixes and man page updates. + +News about GNU Parallel: + +* GNU Parallel course in Copenhagen + https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/ + +* GNU Parallel course in Århus + https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/ + +* GNU Parallel pour accélérer vos process sous Linux + https://www.yvonh.com/gnu-parallel-pour-accelerer-vos-process-sous-linux/ + +* How to copy a file to multiple directories in Linux + https://net2.com/how-to-copy-a-file-to-multiple-directories-in-linux/ + +* Running linux commands in parallel https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8 + + +20191222 + +* GNU Parallel course in Copenhagen + https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-med-ole-tange/ + +* GNU Parallel course in Århus + https://www.prosa.dk/nc/arrangementer/arrangement/gnu-parallel-og-parallelisering-i-unix-shellen/ + +* GNU Parallel is used in + https://github.com/JeffersonLab/rfw_tsf_extractor + +* Bug fixes and man page updates. + + +20191122 + +* GNU Parallel was presented at Driving IT. Slides: + cloud.prosa.dk/s/drivingit + +* Restarting supervisord processes in parallel + https://blog.naderman.de/2019/11/14/restarting-supervisord-processes-in-parallel/ + +* Using GNU Parallel to Create Archives Faster + https://www.reddit.com/r/DataHoarder/comments/dsgmhc/parallel_archiving_techniques/ + +* Bug fixes and man page updates. + + +20191022 + +* --tee will use --output-error=warn-nopipe if supported by tee. + +* GNU Parallel will be presented at Driving IT 2019: + https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools + +* UMN Duluth: Job parallelization with task arrays and GNU parallel + https://www.msi.umn.edu/tutorials/umn-duluth-job-parallelization-task-arrays-and-gnu-parallel + +* Genome updater uses GNU Parallel + https://github.com/pirovc/genome_updater + +* Using GNU-Parallel for bioinformatics + https://www.danielecook.com/using-gnu-parallel-for-bioinformatics/ + +* Speeding up PostgreSQL ETL pipeline with the help of GODS + https://cfengine.com/company/blog-detail/speeding-up-postgresql-etl-pipeline-with-the-help-of-gods/ + +* Runing linux commands in parallel + https://dev.to/voyeg3r/runing-linux-commands-in-parallel-4ff8 + +* Research Computing University of Colorado Boulder contains an intro + to GNU Parallel + https://readthedocs.org/projects/curc/downloads/pdf/latest/ + +* 如何使用Parallel在Shell中并行执行命令 + https://www.myfreax.com/gnu-parallel/ + +* 如何测试 Amazon Elastic File System + https://aws.amazon.com/cn/blogs/china/how-to-test-drive-amazon-elastic-file-system/ + +* Bug fixes and man page updates. + + +20190922 + +* --nice is now inherited by the nice level that GNU Parallel is + started at. So 'nice -n10 parallel' will also cause remote jobs to + be run at nice level 10. + +* --delay is now accurate to within 10 ms + +* GNU Parallel will be presented at Driving IT 2019: + https://ida.dk/arrangementer-og-kurser/konferencer/driving-it/tools + +* Greenland Ice Sheet solid ice discharge from 1986 through 2017 + https://www.earth-syst-sci-data.net/11/769/2019/essd-11-769-2019.pdf + +* App Center Cloud Build Machines > Installed Software > Utilities + https://docs.microsoft.com/en-us/appcenter/build/software + +* Curryfinger - SNI & Host header spoofing utility + https://dualuse.io/blog/curryfinger/ + +* Hyak parallel-sql + https://wiki.cac.washington.edu/display/hyakusers/Hyak+parallel-sql + +* A meditation on analysing data with Perl in parallel using GNU Parallel + https://www.reddit.com/r/perl/comments/cyo2qc/a_meditation_on_analysing_data_with_perl_in/ + +* Accélérer ses tâches avec GNU Parallel et les lots de tâches (UL) + https://www.eventbrite.ca/e/inscription-accelerer-ses-taches-avec-gnu-parallel-et-les-lots-de-taches-ul-71412840729 + +* RMACC Summit GNU Parallel + https://curc.readthedocs.io/en/latest/software/GNUParallel.html + +* Introducing Parallel into Shell + https://petelawson.com/post/parallel-in-shell/ + +* Linux Productivity Tools + https://www.usenix.org/conference/lisa19/presentation/maheshwari + +* Gnu/parallel + Nfs 实现共享文件网络的并发计算等操作 + http://atomicer.cn/2018/01/18/gnu-parallel-nfs-%E5%AE%9E%E7%8E%B0%E5%85%B1%E4%BA%AB%E6%96%87%E4%BB%B6%E7%BD%91%E7%BB%9C%E7%9A%84%E5%B9%B6%E5%8F%91%E8%AE%A1%E7%AE%97%E7%AD%89%E6%93%8D%E4%BD%9C/#more + +* Bug fixes and man page updates. + + +20190822 + +* GNU Parallel will be presented at Driving IT 2019: + https://ida.dk/arrangementer-og-kurser/konferencer/driving-it#beskrivelse + +* Linux Productivity Tools + https://www.usenix.org/conference/lisa19/presentation/maheshwari + +* Improve your reconnaissance performance by using GNU Parallel + https://mailchi.mp/3f46ceb46357/improve-your-reconnaissance-performance-by-using-gnu-parallel + +* Paralel İşler / İşlemler / Programlar Bash’de Nasıl Çalıştırılır? + https://kaleinfo.com/2019/07/29/paralel-isler-islemler-programlar-bashde-nasil-calistirilir-2/ + +* Use POLYBAR to change WALLPAPER with GNU Parallel + https://www.youtube.com/watch?v=rjYg-b_eiRU + +* Finding the Balance Between Speed & Accuracy During an Internet-wide + Port Scanning + https://captmeelo.com/pentest/2019/07/29/port-scanning.html + +* GNU Parallel Ryugu released + https://linuxreviews.org/GNU_Parallel_Ryugu_released + +* CO2017 - CW1 - Operating Systems & Networks - Shell scripting + http://www.7daixie.com/2019071646302396.html + +* Bug fixes and man page updates. + + +20190722 + +* {= uq; =} causes the replacement string to be unquoted. Example: + parallel echo '{=uq;=}.jpg' ::: '*' + +* --tagstring {=...=} is now evaluated for each line with --linebuffer. + +* Use -J ./profile to read a profile in current dir. + +* Speedup of startup by 40%: Find the parent shell differently on + GNU/Linux, cache information about the CPU and which setpgrp method + to use to make GNU Parallel start 40% faster. + +* $PARALLEL_SSHLOGIN can be used in the command line. + +* Occasionally sane: Simple usage of GNU parallel + https://vfoley.xyz/parallel/ + +* How to run multiple bash scripts in parallel + https://techieroop.com/how-to-run-multiple-bash-scripts-in-parallel/ + +* Announcing Oracle Solaris 11.4 SRU10 + https://blogs.oracle.com/solaris/announcing-oracle-solaris-114-sru10 + +* Руководство по использованию GNU Parallel https://zalinux.ru/?p=2623 + +* Bug fixes and man page updates. + + +20190622 + +* --shard can now take a column name and optionally a perl + expression. Similar to --group-by and replacement strings. + +* Using AWK and R to parse 25tb + https://livefreeordichotomize.com/2019/06/04/using_awk_and_r_to_parse_25tb/ + +* Parallel and Visual testing with Behat + http://parallelandvisualtestingwithbehat.blogspot.com/p/blog-page.html + +* 维基百科，自由的百科全书https://zh.wikipedia.org/wiki/GNU_parallel + +* Bug fixes and man page updates. + + +20190522 + +* --group-by groups lines depending on value of a column. The value + can be computed. + +* How to compress (bzip / gzip) a very large text quickly? + https://medium.com/@gchandra/how-to-compress-bzip-gzip-a-very-large-text-quickly-27c11f4c6681 + +* Simple tutorial to install & use GNU Parallel + https://medium.com/@gchandra/simple-tutorial-to-install-use-gnu-parallel-79251120d618 + +* Introducing Parallel into Shell + https://petelawson.com/post/parallel-in-shell/ + +* Bug fixes and man page updates. + + +20190422 + +* Invitation to the 10 years anniversary next year. + +* Bug fixes and man page updates. + + +20190322 + +* SIGTERM is changed to SIGHUP, so sending SIGHUP will make GNU + Parallel start no more jobs, but wait for running jobs to finish. + +* SIGTERM SIGTERM is changed to SIGTERM, so sending SIGTERM will make + GNU Parallel kill all running jobs. + +* GNU Parallel now includes a cheat sheet: parallel_cheat.pdf + +* High Throughput Computing on RMACC Summit and Beyond + https://calendar.colorado.edu/event/high_throughput_computing_on_rmacc_summit_and_beyond#.XH2NBhB7mV4 + +* GNU Parallel Cheat Sheet by cpriest + https://www.cheatography.com/cpriest/cheat-sheets/gnu-parallel/ + +* Use Multiple CPU Cores(Parallelize) with Single Threaded Linux + Commands + http://xensoft.com/use-multiple-cpu-cores-parallelize-with-single-threaded-linux-commands/ + +* Bug fixes and man page updates. + + +20190222 + +* --shard makes it possible to send input to a the same jobslot based + on the value in one column of the input. It is similar to sharding + in databases. + +* --shellquote --shellquote will shell quote the input twice. + +* GNU Parallel is available in Termux + https://github.com/termux/termux-packages/tree/master/packages/parallel + +* Linux, command line & MetaCentrum + https://trapa.cz/sites/default/files/linux_bash_metacentrum_course_4.pdf + +* How to supercharge your bash workflows with GNU parallel + https://medium.freecodecamp.org/how-to-supercharge-your-bash-workflows-with-gnu-parallel-53aab0aea141 + +* GNU Parallel Spring 2017 https://www.youtube.com/watch?v=LHb29uW_KyI + +* Parallelizing Freesurfer blog.cogneurostats.com/?p=148 + +* FreeSurfer #4: Running recon-all in Parallel https://www.youtube.com/watch?v=XHN2tm3tNaw + +* FreeSurfer: recon-all https://www.neurotrivial.com/2019/01/24/freesurfer-recon-all/ + +* Come ridimensionare 10k foto con la riga di comando + https://pigrecoinfinito.wordpress.com/2018/12/22/come-ridimensionare-10k-foto-con-la-riga-di-comando/ + +* 并行处理 – Gnu Parallel：嵌套并行 + https://codeday.me/bug/20190122/552902.html + +* シェルスクリプトでコマンドを並列実行する方法 + https://www.kwbtblog.com/entry/2019/01/12/020423 + +* Bug fixes and man page updates. + + +20190122 + +* 'env_parallel --end-session' makes it possible to nest 'env_parallel + --session' + +* Using GNU Parallel in pentesting https://youtu.be/mZ0OUJmkIlA?t=873 + +* Supercomputer Workshop: Feb 1&7 + http://www.ece.unm.edu/featured-students/supercomputer-workshop-feb-17.html + +* Bug fixes and man page updates. + + +20181222 + +* Better /proc/cpuinfo parser. + +* Simpler job scheduling flow. + +* MPGI Workshop: Job Parallelization with Task Arrays and GNU Parallel + https://www.msi.umn.edu/tutorials/mpgi-workshop-module-4 + +* CONCOCT uses GNU Parallel + https://media.readthedocs.org/pdf/concoct/latest/concoct.pdf + +* If you use SLURM read + https://wiki.hpc.uconn.edu/index.php/Advanced_SLURM + +* すぐ忘れてしまう、仕事で使う技 + https://qiita.com/hana_shin/items/53c3c78525c9c758ae7c + +* Bug fixes and man page updates. + + +20181122 + +* Experimental simpler job flow control. + +* 時間がかかるコマンドを GNU parallel で 並列実行する + https://qiita.com//grohiro/items/4db3fa951a4778c5c479 + +* Bug fixes and man page updates. + + +20181022 + +* env_parallel.fish: --session support (alpha quality) + +* GNU Parallel was cited in: High-throughput sequencing of murine + immunoglobulin heavy chain repertoires using single side unique + molecular identifiers on an Ion Torrent PGM + https://doi.org/10.18632/oncotarget.25493 + +* GNU parallel in Japanese Wikipedia + https://ja.wikipedia.org/wiki/GNU_parallel + +* Outils de paramétrisation des tâches: lots de tâches, GNU Parallel + https://www.eventbrite.ca/e/inscription-outils-de-parametrisation-des-taches-lots-de-taches-gnu-parallel-et-bqtools-midi-conference-de-50271076142 + +* Bug fixes and man page updates. + + +20180922 + +* Minix is supported again. + +* Updated graph showing GNU Parallel's overhead per job for each + version. https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf + +* Intro to Computing at CARC includes introduction to GNU Parallel + http://carc.unm.edu/education--training/workshops-and-seminars.html + +* Fast-GBS uses GNU Parallel https://bitbucket.org/jerlar73/fast-gbs/wiki/Home + +* Belgium at 10 m resolution in July 2018 http://www.cesbio.ups-tlse.fr/multitemp/?p=14116 + +* Bug fixes and man page updates. + + +20180822 + +* parset sets exit code. + +* How to install GNU Parallel + https://www.techrepublic.com/videos/how-to-install-gnu-parallel/ + +* Bug fixes and man page updates. + + +20180722 + +* The quoting engine has been changed. Instead of using \-quoting GNU + Parallel now uses '-quoting in bash/ash/dash/ksh. This should + improve compatibility with different locales. This is a big change + causing this release to be alpha quality. + +* The CPU calculation has changed. By default GNU Parallel uses the + number of CPU threads as the number of CPUs. This can be changed to + the number of CPU cores or number of CPU sockets with + --use-cores-instead-of-threads or --use-sockets-instead-of-threads. + +* The detected number of sockets, cores, and threads can be shown with + --number-of-sockets, --number-of-cores, and --number-of-threads. + +* env_parallel now support mksh using env_parallel.mksh. + +* GNU Parallel is distributed as part of Snippy + https://github.com/tseemann/snippy + +* GNU Parallel: Ejecutar comandos simultáneamente en Linux + https://esgeeks.com/gnu-parallel-ejecutar-comandos-simultaneo-linux/ + +* Parallel download genomic data with GNU-Parallel + https://digibio.blogspot.com/search/label/GNU-Parallel + +* Bug fixes and man page updates. + + +20180622 + +* Deal better with multibyte chars by forcing LC_ALL=C. + +* GNU Parallel was introduced in Pincount Podcast: + https://pincountpodcast.com/episodes/29.html + +* GNU Parallel was shown on Danish national news for 1.7 seconds: dr.dk + +* How to run Linux commands simultaneously with GNU Parallel + https://www.techrepublic.com/article/how-to-run-commands-simultaneously-with-gnu-parallel/#ftag=RSS56d97e7 + +* Easy parallelization with GNU parallel + http://mpharrigan.com/2016/08/02/parallel.html + +* GNU Parallel for mutlithreaded tasks + http://slhogle.github.io/2016/gnu-parallel/ + +* A GNU Parallel Clustering Demo + https://www.crowdsupply.com/ground-electronics/circumference/updates/a-gnu-parallel-clustering-demo + +* 使用 GNU Parallel 提高 Linux 命令行执行效率 + https://linux.cn/article-9718-1.html + +* Ejecutando tareas desde consola simultáneamente con GNU Parallel + https://poesiabinaria.net/2018/06/ejecutando-tareas-desde-consola-simultaneamente-gnu-parallel/ + +* Cómo ejecutar varias tareas simultáneamente en el terminal con GNU + Parallel + https://www.ubuntizando.com/como-ejecutar-varias-tareas-simultaneamente-en-el-terminal-con-gnu-parallel/ + +* GNU Parallel 활용 가이드 http://genoglobe.kr/kribb/gnu_parallel + +* Bug fixes and man page updates. + + +20180522 + +* --tty allows for more programs accessing /dev/tty in parallel. Some + programs require tty access without using it. + +* env_parallel --session will record names in current environment in + $PARALLEL_IGNORED_NAMES and exit. It is only used with env_parallel, + and can work like --record-env but in a single session. + +* 35 day course: Linux shell scripting and text processing for big + data https://comquest.in/training + +* How To Use Your Entire CPU In Bash With Parallel + https://bash-prompt.net/guides/parallell-bash/ + +* An easy way to run parallel jobs on Stampede2 + https://blog.uta.edu/xus/2017/09/29/an-easy-way-to-run-parallel-jobs-on-stampede2/ + +* Get more done at the Linux command line with GNU Parallel + https://opensource.com/article/18/5/gnu-parallel + +* Save Time with Modern Search Techniques + https://www.sans.org/summit-archives/file/summit-archive-1524582079.pdf + +* GNU Parallel: haz más cosas simultáneamente en el terminal + https://blog.desdelinux.net/gnu-parallel-haz-mas-cosas-simultaneamente-en-el-terminal/ + +* 「今日から使い切る」ための GNU Parallelによる並列処理入門 + https://www.slideshare.net/koji_matsuda/gnu-parallel + +* Bug fixes and man page updates. + + +20180422 + +* --csv makes GNU Parallel parse the input sources as CSV. When used + with --pipe it only passes full CSV-records. + +* Time in --bar is printed as 1d02h03m04s. + +* Optimization of --tee: It spawns a process less per value. + +* The GNU Parallel 2018 book is now available: + http://www.lulu.com/shop/ole-tange/gnu-parallel-2018/paperback/product-23558902.html + +* Modern pentest tricks for faster, wider, greater engagement (15) + https://conference.hitb.org/hitbsecconf2018ams/materials/D1%20COMMSEC%20-%20Thomas%20Debize%20-%20Modern%20Pentest%20Tricks%20for%20Faster,%20Wider,%20Greater%20Engagements.pdf + +* Running many serial jobs efficiently + https://userinfo.surfsara.nl/documentation/running-many-serial-jobs-efficiently + +* GNU Parallel: как сохранить результаты нескольких команд для + переменной? http://fliplinux.com/gnu-parallel-6.html + +* Running Multiple Commands in Parallel on a GNU Linux + https://www.youtube.com/watch?v=sHpTywpb4_4 + +* Klaatu covers the documentation of GNU parallel in episode 12x15 + http://gnuworldorder.info/ + +* Bug fixes and man page updates. + + +20180322 + +* niceload -p can now take multiple pids separated by comma + +* --timeout gives a warning when killing processes + +* --embed now uses the same code for all supported shells + +* --delay can now take arguments like 1h12m07s + +* Parallel. Straight from your command line + https://medium.com/@alonisser/parallel-straight-from-your-command-line-feb6db8b6cee + +* GNU Parallel was used in POAP-Parallelized Open Babel & Autodock + suite Pipeline https://github.com/inpacdb/POAP + +* Pi Cluster Parallel Script First Fire + https://chiefio.wordpress.com/2018/02/23/pi-cluster-parallel-script-first-fire/ + +* How to Restore MySQL Logical Backup at Maximum Speed + https://www.percona.com/blog/2018/02/22/restore-mysql-logical-backup-maximum-speed/ + +* Bug fixes and man page updates. + + +20180222 + +* --embed makes it possible to embed GNU parallel in a shell + script. This is useful if you need to distribute your script to + someone who does not want to install GNU parallel. + +* Parallelize Your Large Batches of Small Jobs + https://amito.me/2018/02/Parallelize-Your-Large-Batches-of-Small-Jobs/ + +* Klaatu expounds upon xargs and talks GNU parallel in episode 12x6 + http://gnuworldorder.info/ + +* How to use parallel to speed up your work + https://mike42.me/blog/how-to-use-parallel-to-speed-up-your-work + +* Transient compute clustering with GNU Parallel and sshfs + https://dennismungai.wordpress.com/2018/02/06/transient-compute-clustering-with-gnu-parallel-and-sshfs/ + +* Useful Examples of ffmpeg and GNU parallel on the command-line + https://dennismungai.wordpress.com/2018/02/06/useful-examples-of-ffmpeg-and-gnu-parallel-on-the-command-line/ + +* Data Science at the Command Line (Chapter 8.3) + https://www.datascienceatthecommandline.com/ + +* Bug fixes and man page updates. + + +20180122 + +* bash / 병렬 https://code.i-harness.com/ko/docs/bash/2a1a + +* 15分钟神器gnu parallel 入门观止 + http://www.ezilin.com/2018/01/15gnu-parallel.html + +* How To Run Multiple Commands In Parallel on Linux + https://www.slashroot.in/how-run-multiple-commands-parallel-linux + +* Bug fixes and man page updates. + + +20171222 + +* env_parset for ash, dash, ksh, sh, zsh + +* Automatically create hostgroups if argument ends in @sshlogin + +* Tips for running jobs on your VM + https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel + +* Node-local scheduling + https://mogonwiki.zdv.uni-mainz.de/dokuwiki/node_local_scheduling + +* GNU Parallel https://docs.computecanada.ca/wiki/GNU_Parallel + +* GNU Parallel のエラー処理 https://qiita.com/inouet/items/bfc208668c86caf8ff74 + +* Using GNU Parallel + https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel + +* Bug fixes and man page updates. + + +20171122 + +* Using GNU Parallel to speed up Google Cloud Infrastructure + management + https://medium.com/@pczarkowski/using-gnu-parallel-to-speed-up-google-cloud-infrastructure-management-53e5c555ec05 + +* What is gnu parallel + http://wiki.chpc.ac.za/howto:bioinformatics:gnu-parallel + +* Parallel, Scripts, Clusters, & Easy Use + https://chiefio.wordpress.com/2017/11/10/parallel-scripts-clusters-easy-use/ + +* Bug fixes and man page updates. + + +20171022 + +* Initial support for XDG Base Directory $XDG_* environment variables. + +* Validating half a million TIFF files. Part + Two + https://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/ + +* Turing data science class: Cluster computing + https://www.turing.ac.uk/events/masterclass-cluster-computing/ + +* Butlin:Unix for Bioinformatics - advanced tutorial + https://openwetware.org/wiki/Butlin:Unix_for_Bioinformatics_-_advanced_tutorial + +* พยายามใช้ CPU ให้ครบทุก CORE + https://veer66.wordpress.com/2017/09/02/use-multi-core/ + +* Examples on using GNU Parallel + https://gist.github.com/drmalex07/de8ff1379a560f6d84a0d863e60ae378 + +* Bug fixes and man page updates. + + +20170922 + +* Use '--limit myprog' to make a dynamic job limit. Just return 0 to + spawn another job, 1 to not spawn another job, and 2 to kill the + youngest job. + +* PARALLEL_RSYNC_OPTS and --rsync-opts sets the options for rsync + (Default: -rlDzR). + +* Download all of humble bundle books in parallel + https://til.hashrocket.com/posts/ggt1jaes4y-download-all-of-humble-bundle-books-in-parallel + +* Bug fixes and man page updates. + + +20170822 + +* --line-buffer no longer uses tempfiles. This is faster and makes it + possible for a single process to output more data than there is free + disk space. + +* Vote for GNU Parallel's community ads on + http://meta.unix.stackexchange.com/a/4356/2972 + http://meta.askubuntu.com/a/16750/22307 + http://meta.serverfault.com/a/9040/45704 + +* Edit images with GNU Parallel and ImageMagick + https://fedoramagazine.org/edit-images-parallel-imagemagick/ + +* Running Bash Commands in Parallel + https://dzone.com/articles/running-bash-commands-in-parallel-1 + +* Today I Learned: GNU parallel, plate tectonics + https://medium.com/@nornagon/today-i-learned-gnu-parallel-plate-tectonics-9fcf24045e63 + +* GNU Parallel Tutorial + https://www.upf.edu/web/sct-sit/gnu-parallel-tutorial + +* Validating half a million TIFF files + http://www.dpoc.ac.uk/2017/08/17/validating-half-a-million-tiff-files-part-two/ + +* Blender and GNU Parallel + https://www.blendernation.com/2017/08/16/blender-gnu-parallel/ + +* Quick Introduction to GNU Parallel + https://github.com/LangilleLab/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel + +* A simple distributed animation render example using GNU Parallel + https://gitlab.com/skororu/scripts + +* Do stuff on things, in parallel + http://blogs.fluidinfo.com/terry/2017/08/05/do-stuff-on-things-in-parallel/ + +* Bash And GNU Parallel NGS Bidniz + http://ino.pm/outreach/presentations/2014/03/genomics-wranglers/index.html + +* Using for loop vs Gnu parallel for BLAST + http://www.ettemalab.org/using-for-loop-vs-gnu-parallel-for-blast/ + +* 并行rsync https://gxnotes.com/article/175866.html + +* Bug fixes and man page updates. + + +20170722 + +* Vote for GNU Parallel's community ads on + http://meta.unix.stackexchange.com/a/4356/2972 + http://meta.askubuntu.com/a/16750/22307 + http://meta.serverfault.com/a/9040/45704 + +* GNU Parallel was cited in: Hayabusa: Simple and Fast Full-Text + Search Engine for Massive System Log Data + http://dl.acm.org/citation.cfm?id=3095788 + +* コマンドの並列化を行える『GNU parallel』の個人的使い方まとめ + https://orebibou.com/2017/07/%E3%82%B3%E3%83%9E%E3%83%B3%E3%83%89%E3%81%AE%E4%B8%A6%E5%88%97%E5%8C%96%E3%82%92%E8%A1%8C%E3%81%88%E3%82%8B%E3%80%8Egnu-parallel%E3%80%8F%E3%81%AE%E5%80%8B%E4%BA%BA%E7%9A%84%E4%BD%BF%E3%81%84/ + +* How to play and play with thousands of digitized 78rpm records + https://blog.archive.org/2017/07/10/how-to-play-and-play-with-78rpm-record-transfers/ + +* 并行一个for循环 https://gxnotes.com/article/130363.html + +* RFC 8142: GeoJSON Text Sequences + https://sgillies.net/2017/05/18/rfc-8142-geojson-text-sequences.html + +* Git auto fetch script I run every day + https://lukas.zapletalovi.com/2017/07/git-auto-fetch-script-i-run-every-day.html + +* cores, cpus and threads + http://crazyhottommy.blogspot.de/2017/07/cores-cpus-and-threads.html + +* Bug fixes and man page updates. + + +20170622 + +* The command line can now contain \257 (Macron) or UTF characters + containing \257. + +* Vote for GNU Parallel's community ads on + http://meta.unix.stackexchange.com/a/4356/2972 + http://meta.askubuntu.com/a/16750/22307 + http://meta.serverfault.com/a/9040/45704 + +* Graph for overhead for 1000 jobs has been updated. It remains + steadily at 3.5 ms per job on a 1.7 GHz machine + https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf + +* GNU Parallel was cited in: The topology of the directed clique + complex as a network invariant + https://springerplus.springeropen.com/articles/10.1186/s40064-016-2022-y + +* GNU Parallel was cited in: Improving Optical Character Recognition + of Finnish Historical Newspapers with a Combination of Fraktur & + Antiqua Models and Image + http://www.ep.liu.se/ecp/131/038/ecp17131038.pdf + +* GNU Parallel was cited in: Parallel Execution of Structural Mechanic + Tasks with Use of Small Supercomputers + http://www.sciencedirect.com/science/article/pii/S1877705817324815 + +* GNU Parallel was cited in: Integration of a Multilingual Preordering + Component into a Commercial SMT Platform + https://www.degruyter.com/downloadpdf/j/pralin.2017.108.issue-1/pralin-2017-0009/pralin-2017-0009.pdf + +* Tips For Running Jobs On Your VM + https://support.ehelp.edu.au/support/solutions/articles/6000089713-tips-for-running-jobs-on-your-vm#parallel + +* Speed up ML model development with GNU Parallel + https://pzelasko.github.io/posts/speed-up-ml-model-development-with-gnu-parallel + +* Parallelizing a Python Function for the Extremely Lazy + http://tdhopper.com/blog/2017/Jun/07/parallelizing-a-python-function-for-the-extremely-lazy/ + +* 使用GNU parallel + http://www.android5.online/Android/androidjc/androidkf/gykf/201603/8741.html + +* Bug fixes and man page updates. + + +20170522 + +* --timeout can now use s=second,m=minute,h=hour,d=day. + +* --dr is now an alias for --dry-run. + +* Vote for GNU Parallel's community ads on + http://meta.unix.stackexchange.com/a/4356/2972 + http://meta.askubuntu.com/a/16750/22307 + http://meta.serverfault.com/a/9040/45704 + +* GNU Parallel was cited in: Feature Detection in Visual Cortex during + Different Functional States + https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5397493/ + +* GNU Parallel was cited in: From genotype to phenotype: inferring + relationships between microbial traits and genomic components + https://docserv.uni-duesseldorf.de/servlets/DerivateServlet/Derivate-44622/main.pdf + +* GNU Parallel was cited in: Designing fecal microbiota transplant + trials that account for differences in donor stool efficacy + http://biorxiv.org/content/biorxiv/early/2016/07/25/065383.full.pdf + +* GNU Parallel was cited in: Assessing the predictability of + anharmonic vibrational modes at the example of hydroxyl groups - ad + hoc construction of localised modes and the influence of structural + solute–solvent motifs + http://pubs.rsc.org/-/content/articlelanding/2017/cp/c7cp01662j#!divAbstract + +* GNU Parallel was cited in: Mapping Environmental Influences on + Utility Fire Threat + ftp://frapftp.fire.ca.gov/outgoing/transfer/PUC_Map1/Utility%20Fire%20map%201%20final%20review%20and%20development%20report21616.pdf + +* GNU Parallel was cited in: Weak vs. Strong Disorder Superfluid-Bose + Glass Transition in One Dimension + https://arxiv.org/pdf/1704.02257.pdf + +* GNU Parallel was cited in: Online Automatic Post-editing for MT in a + Multi-Domain Translation Environment + https://www.aclweb.org/anthology/E/E17/E17-1050.pdf + +* GNU Parallel was cited in: Cross-calibration of S-NPP VIIRS + moderate-resolution reflective solar bands against MODIS Aqua over + dark water scenes + http://www.atmos-meas-tech.net/10/1425/2017/amt-10-1425-2017.pdf + +* GNU Parallel was cited in: Scattering Networks: Efficient 2D + Implementation And Application To Melanoma Classification + http://amslaurea.unibo.it/12261/1/nurrito_eugenio_tesi_fisica_magistrale.pdf + +* GNU Parallel was cited in: Genome-scale detection of positive + selection in 9 primates predicts human-virus evolutionary conflicts + http://biorxiv.org/content/biorxiv/early/2017/04/27/131680.full.pdf + +* GNU Parallel is used in: Creates a speech dataset for deep learning + https://github.com/jupiter126/Create_Speech_Dataset + +* GNU Parallel is used in: Parse and process the demixing secrets + dataset (DSD100) https://github.com/faroit/dsdtools + +* First glance at the gnu parallel utility + https://ibiscybernetics.com/blog/2017-04-05.html + +* Installing parallel from source + https://bitsanddragons.wordpress.com/2017/05/03/installing-parallel-from-source/ + +* How to run command or code in parallel in bash shell under Linux or + Unix + https://www.cyberciti.biz/faq/how-to-run-command-or-code-in-parallel-in-bash-shell-under-linux-or-unix/ + +* Parallel Serial Jobs Using GNU Parallel + http://www.hpc.lsu.edu/training/weekly-materials/2017-Spring/gnuparallel-Feb2017.pdf + +* GNU Parallel or How to list millions of S3 objects + https://joeray.me/gnu-parallel-how-to-list-millions-objects.html + +* Which Is the Best Tool for Copying a Large Directory Tree Locally? + http://arjon.es/2017/05/11/which-is-the-best-tool-for-copying-a-large-directory-tree-locally/ + +* Bug fixes and man page updates. + + +20170422 + +* --halt supports done in addition to success and fail. + +* parset will set variables in parallel in Bash. + +* Perl 5.6 on Irix is no longer supported. + +* Vote for GNU Parallel's community ads on + http://meta.unix.stackexchange.com/a/4356/2972 + http://meta.askubuntu.com/a/16750/22307 + http://meta.serverfault.com/a/9040/45704 + +* GNU Parallel was cited in: Halvade-RNA: Parallel variant calling + from transcriptomic data using MapReduce + http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0174575 + +* GNU Parallel was cited in: StrAuto: automation and parallelization + of STRUCTURE analysis + http://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-017-1593-0 + +* GNU Parallel was cited in: Trespassing the Boundaries: Labeling + Temporal Bounds for Object Interactions in Egocentric Video + https://128.84.21.199/pdf/1703.09026.pdf + +* GNU Parallel is used in: https://github.com/lucascbeyeler/zmbackup + +* Using GNU Parallel + https://wiki.ncsa.illinois.edu/display/ROGER/Using+GNU+Parallel + +* Find and xargs and parallel + http://helpful.knobs-dials.com/index.php/Find_and_xargs_and_parallel#Parallel + +* Quick Introduction to GNU Parallel + https://github.com/mlangill/microbiome_helper/wiki/Quick-Introduction-to-GNU-Parallel + +* Data science at the command line https://www.slideshare.net/sharatsc/data-science-at-the-command-line + +* Bedtools笔记 http://www.jianshu.com/p/67b0665490ac + +* Bug fixes and man page updates. + + +20170322 + +* --rpl can now take arguments by adding '(regexp)' in the replacement + string. + +* Vote for GNU Parallel's community ads on + http://meta.unix.stackexchange.com/a/4356/2972 + http://meta.askubuntu.com/a/16750/22307 + http://meta.serverfault.com/a/9040/45704 + +* GNU Parallel was cited in: shmlast: An improved implementation of + Conditional Reciprocal Best Hits with LAST and Python + https://joss.theoj.org/papers/3cde54de7dfbcada7c0fc04f569b36c7 + +* GNU Parallel was cited in: Prediction of relativistic electron flux + in the Earth’s outer radiation belt at geostationary orbit by + adaptive methods + https://link.springer.com/article/10.1134/S0016793217010108 + +* GNU Parallel was cited in: Higher likelihood of multiple bit-flips + due to neutron-induced strikes on logic gates + https://arxiv.org/pdf/1612.08239.pdf + +* GNU Parallel was cited in: A Monte Carlo Resampling Approach for the + Calculation of Hybrid Classical and Quantum Free Energies + http://pubs.acs.org/doi/pdfplus/10.1021/acs.jctc.6b00506 + +* GNU Parallel was cited in: Learning string distance with smoothing + for OCR spelling correction + https://link.springer.com/article/10.1007/s11042-016-4185-5 + +* GNU Parallel was cited in: The Breakdown of String Perturbation + Theory for Many External Particles + https://arxiv.org/pdf/1611.08003.pdf + +* GNU Parallel was cited in: Operations Research Applications in + Nuclear Energy + https://dspace.library.colostate.edu/bitstream/handle/11124/170687/Johnson_mines_0052E_11207.pdf?sequence=1&isAllowed=y + +* GNU Parallel was cited in: Parallel Computing: GNU Parallel + http://www.blopig.com/blog/2017/02/parallel-computing-gnu-parallel/ + +* Stig Sandbeck Mathisen: Change All The Passwords (Again) + http://garf.us/2017/02/stig-sandbeck-mathisen-change-all-the-passwords-again/ + +* Trabalhando como Paralelismo no Bash usando o GNU Parallel + http://www.beyeler.com.br/2017/03/trabalhando-como-paralelismo-no-bash-usando-o-gnu-parallel/ + +* GNU parallel と SQL*Loader 組み合わせ実行例 + https://blogs.oracle.com/LetTheSunShineIn/entry/gnu_parallel_%E3%81%A8_sql_loader + +* Bug fixes and man page updates. + + +20170222 + +* env_parallel now supports /bin/sh, ash, dash. + +* --tee will pipe all data to all jobs. Used with --pipe/--pipepart + and :::. Small example: seq 3333 | parallel --pipe --tee --tag 'grep + {} | wc -l' ::: {0..9} + +* If --results {replstr} ends in /: save in dir. Otherwise save as + file. Example: parallel --results {} echo {} ::: a b c + +* Vote for GNU Parallel's community ads on + http://meta.unix.stackexchange.com/a/4356/2972 + http://meta.askubuntu.com/a/16750/22307 + http://meta.serverfault.com/a/9040/45704 + +* GNU Parallel was cited in: Low-delay forwarding with multiple + candidates for VANETs using multi-criteria decision making + http://ieeexplore.ieee.org/document/7835961/ + +* GNU Parallel was cited in: An Integrated Simulator and Dataset that + Combines Grasping and Vision for Deep Learning + https://arxiv.org/pdf/1702.02103.pdf + +* GNU Parallel was cited in: A Bayesian model selection approach for + identifying differentially expressed transcripts from RNA sequencing + data http://onlinelibrary.wiley.com/doi/10.1111/rssc.12213/full + +* GNU Parallel was cited in: The impact of copy number variation on + gout, and the apple genome + https://ourarchive.otago.ac.nz/bitstream/handle/10523/7060/BoocockJames2016MSc.pdf?sequence=3 + +* GNU Parallel was cited in: Reaction rates for reaction-diffusion + kinetics on unstructured meshes + http://aip.scitation.org/doi/10.1063/1.4975167 + +* GNU Parallel was cited in: Modeling prediction error improves power + of transcriptome-wide association studies + http://biorxiv.org/content/biorxiv/early/2017/02/14/108316.full.pdf + +* GNU Parallel was cited in: Proper experimental design requires + randomization/balancing of molecular ecology experiments + http://biorxiv.org/content/biorxiv/early/2017/02/17/109280.full.pdf + +* GNU Parallel was cited in: Experiment-based thermal micromagnetic + simulations of the magnetization reversal for ns-range clocked + nanomagnetic logic + http://aip.scitation.org/doi/full/10.1063/1.4974021 + +* GNU Parallel was cited in: The University of Edinburgh’s systems + submission to the MT task at IWSLT + http://workshop2016.iwslt.org/downloads/IWSLT_2016_paper_27.pdf + +* Fast-GBS uses GNU Parallel: https://bitbucket.org/jerlar73/fast-gbs + +* Job: DevOps Engineer/Senior Systems Administrator in New York, New + York + http://rockefeller.jobs/new-york-ny/devops-engineersenior-systems-administrator/2DB3408EAC9E4617AD238550F31C7641/job/ + +* Training in GNU Parallel: + https://www.carc.unm.edu/education-outreach/workshops--training/ + +* Training in GNU Parallel: + http://www.hpc.lsu.edu/training/registration.php?topic=Parallel%20Serial%20Jobs%20Using%20GNU%20Parallel&date=February%2022,%202017&time=9:00%20AM%20-%2011:00%20AM&place=307%20Frey&deadline=2017-02-21%2016:30:00 + +* Batch Convert Images from PNG to JPEG + http://coreygoldberg.blogspot.dk/2017/02/batch-convert-images-from-png-to-jpeg.html + +* Accelerating Oxford Nanopore Basecalling + http://fowlerlab.org/2017/01/26/accelerating-oxford-nanopore-basecalling/ + +* parallel и imagemagick в loop на bash + https://www.linux.org.ru/forum/development/13190247 + +* Bug fixes and man page updates. + + +20170206alpha + +* --tee introduced. + + +20170122 + +* sql now uses a temporary credentials file for MySQL to avoid + warning. + +* --sqlmaster and --sqlworker have been reworked. + +* --sqlworker only reads from the DBURL: any command and any arguments + are ignored. + +* --sqlmaster +DBURL will append different commands to the DBURL and + not erase the table. + +* If --results contain a replacement string, no tree structure with + args will be generated. + +* --fg --tmux or --fg --tmuxpane will connect to the tmux. + +* GNU Parallel was cited in: Fast, Automated Indoor Light Detection, + Classification, and Measurement + https://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-212.pdf + +* GNU Parallel was cited in: Unbiased RNA Shotgun Metagenomics in + Social and Solitary Wild Bees Detects Associations with Eukaryote + Parasites and New Viruses + http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0168456 + +* GNU Parallel was cited in: Almost Event-Rate Independent Monitoring + of Metric Temporal Logic + http://people.inf.ethz.ch/trayteld/papers/tacas17-aerial/aerial.pdf + +* 使用GNU parallel命令并行预处理数据: https://blog.razrlele.com/p/1843 + +* GNU Parallel as a queuing system: + http://puntoblogspot.blogspot.com/2017/01/gnu-parallel-as-queuing-system.html + +* AWS re:Invent 2016: Deep Dive on Amazon Elastic File System (STG202) + slide 45 + http://www.slideshare.net/AmazonWebServices/aws-reinvent-2016-deep-dive-on-amazon-elastic-file-system-stg202 + and https://youtu.be/PlTuJx4VnGw?t=30m16s + +* Bug fixes and man page updates. + + +20161222 + +* --results foo.csv will save output as a CSV-file. Can be directly + imported into R or LibreCalc. + +* When using --pipepart a negative --block-size is not interpreted as + a block size but as the number of blocks each jobslot should have. + +* --sqlmaster/--sqlandworker will append jobs to the DBURL if the + DBURL is prepended with +. + +* GNU Parallel was cited in: A cloud-based workflow to quantify + transcript-expression levels in public cancer compendia + http://www.nature.com/articles/srep39259 + +* GNU Parallel was cited in: Determination of crystal structures of + proteins of unknown identity using a marathon molecular replacement + procedure: Structure of Stenotrophomonas maltophilia + phosphate-binding protein + https://www.researchgate.net/publication/308186413_Determination_of_crystal_structures_of_proteins_of_unknown_identity_using_a_marathon_molecular_replacement_procedure_Structure_of_Stenotrophomonas_maltophilia_phosphate-binding_protein + +* GNU Parallel was cited in: Large-scale benchmarking reveals false + discoveries and count transformation sensitivity in 16S rRNA gene + amplicon data analysis methods used in microbiome studies + http://microbiomejournal.biomedcentral.com/articles/10.1186/s40168-016-0208-8 + +* GNU Parallel was cited in: Decomposing Images into Layers via + RGB-space Geometry + https://cs.gmu.edu/~ygingold/singleimage/Decomposing%20Images%20into%20Layers%20via%20RGB-space%20Geometry%20(Tan%20et%20al%202016%20TOG)%20small.pdf + +* Transient compute clustering with GNU Parallel and sshfs + https://gist.github.com/Brainiarc7/24c966c8a001061ee86cc4bc05826bf4 + +* 4 Ways to Batch Convert Your PNG to JPG and Vice-Versa + http://www.tecmint.com/linux-image-conversion-tools/ + +* All's Fair in Love and Distributed Storage + http://cohesity.com/blog/alls-fair-love-distributed-storage/ + +* How can I use GNU Parallel to run a lot of commands in parallel + https://www.msi.umn.edu/support/faq/how-can-i-use-gnu-parallel-run-lot-commands-parallel + +* 정해영의 블로그 - JEONG Haeyoung's blog + http://blog.genoglobe.com/2016/11/gnu-parallel.html + +* 在Linux下将PNG和JPG批量互转的四种方法 + http://os.51cto.com/art/201612/524182.htm + +* Running in parallel http://tomkimpson.com/howto/gnuparallel/ + +* Taco Bell Parallel Programming + https://giorgos.sealabs.net/taco-bell-parallel-programming.html + +* Bug fixes and man page updates. + + +20161122 + +* --record-env can now be used with env_parallel for bash, ksh, pdksh, + and zsh. + +* GNU Parallel was cited in: An improved implementation of Conditional + Reciprocal Best Hits with LAST and Python + https://pypi.python.org/pypi/shmlast/1.0.3 + +* GNU Parallel was cited in: miRPathDB: a new dictionary on microRNAs + and target pathways + http://nar.oxfordjournals.org/content/early/2016/10/13/nar.gkw926.full + +* GNU/Parallel – Run multiple commands simultaneously + https://vinusumi.wordpress.com/2016/11/08/gnuparallel-run-multiple-commands-simultaneously/ + +* Tutorial: Parallel web scraping with CasperJS and GNU Parallel + http://g-liu.com/blog/2016/10/tutorial-parallel-web-scraping-with-casperjs-and-gnu-parallel/ + +* Bug fixes and man page updates. + + +20161022 + +* First command no longer gets stdin as it causes unpredictable issues. + +* GNU Parallel was cited in: Efficiently parallelized modeling of + tightly focused, large bandwidth laser pulses + https://arxiv.org/pdf/1609.08146v1.pdf + +* How to crunch lots of geodata in parallel + http://blog.faraday.io/how-to-crunch-lots-of-geodata-in-parallel/ + +* GNU parallel is my new toaster + http://amedee.me/gnu-parallel-is-my-new-toaster/index.html + +* Bug fixes and man page updates. + + +20160922 + +* parcat - cat files or fifos in parallel + +* GNU Parallel was cited in: Velocity: A Netflow Based Optimized + Geo-IP Lookup Tool + https://mospace.umsystem.edu/xmlui/bitstream/handle/10355/50842/Thesis_2016_Pakhare.pdf?sequence=1&isAllowed=y + +* GNU Parallel was cited in: Viral deep sequencing needs an adaptive + approach: IRMA, the iterative refinement meta-assembler + http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5011931/ + +* Using GNU Parallel and ImageMagick for Conversions + https://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/ + +* Training in GNU Parallel + http://www.cism.ucl.ac.be/Services/Formations/parcomp.pdf + +* Chown Ceph OSD data directory using GNU Parallel + http://blog.widodh.nl/2016/08/chown-ceph-osd-data-directory-using-gnu-parallel/ + +* FastGBS uses GNU Parallel https://bitbucket.org/jerlar73/fastgbs + +* dDocent: A guide to ddRAD sequencing + https://ddocent.wordpress.com/ddocent-pipeline-user-guide/ + +* SOFTWARE GNU Parallel + http://msi-riss.readthedocs.io/en/latest/software/gnu-parallel.html + +* Bug fixes and man page updates. + + +20160822 + +* --tmuxpane opens jobs in panes in tmux. Useful if you want to + monitor progress of less than 100 simultaneous jobs. + +* --linebuffer now treats \r as line ending, too. + +* Perl changes forces use of floats to be given with leading zero, so + 0.1 and not .1 + +* --xapply renamed to --link. + +* Support for pdksh will fade until someone packages it for Ubuntu 16. + +* GNU Parallel was cited in: Exome sequencing of geographically + diverse barley landraces and wild relatives gives insights into + environmental adaptation + http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3612.html?WT.feed_name=subjects_genetics#references + +* GNU Parallel was cited in: Vision-Enhanced Lidar Odometry and + Mapping https://www.ri.cmu.edu/pub_files/2016/8/DLL-thesis.pdf + +* Easy parallelization with GNU parallel + http://mpharrigan.com/2016/08/02/parallel.html + +* Facebook V: Predicting Check Ins, Winner's Interview: 2nd Place, + Markus Kliegl + http://blog.kaggle.com/2016/08/02/facebook-v-predicting-check-ins-winners-interview-2nd-place-markus-kliegl/ + +* Parallel import + http://www.manitou-mail.org/blog/2016/07/parallel-import/ + +* Large file batch processing using NodeJs and GNU Parallel + http://www.zacorndorff.com/2016/07/27/large-file-batch-processing-using-nodejs-and-gnu-parallel/ + +* Bug fixes and man page updates. + + +20160722 + +* env_parallel is now ready for wider testing. It is still beta + quality. + +* env_parallel is heavily modified for all shells and testing has been + increased. + +* Selectively choosing what to export using --env now works for + env_parallel (bash, csh, fish, ksh, pdksh, tcsh, zsh). + +* --round-robin now gives more work to a job that processes faster + instead of same amount to all jobs. + +* --pipepart works on block devices on GNU/Linux. + +* GNU Parallel was cited in: HybPiper: Extracting Coding Sequence and + Introns for Phylogenetics from High-Throughput Sequencing Reads + Using Target Enrichment + http://www.bioone.org/doi/full/10.3732/apps.1600016 + +* GNU Parallel was cited in: StrAuto - Automation and Parallelization + of STRUCTURE Analysis + http://www.crypticlineage.net/download/strauto/strauto_doc.pdf + +* GNU Parallel was cited in: Tools and techniques for computational + reproducibility + http://gigascience.biomedcentral.com/articles/10.1186/s13742-016-0135-4 + +* GNU Parallel was cited in: FlashPCA: fast sparse canonical + correlation analysis of genomic data + http://biorxiv.org/content/biorxiv/suppl/2016/04/06/047217.DC1/047217-1.pdf + +* GNU Parallel was cited in: Math Indexer and Searcher under the Hood: + Fine-tuning Query Expansion and Unification Strategies + http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings12/pdf/ntcir/MathIR/05-NTCIR12-MathIR-RuzickaM.pdf + +* GNU Parallel was cited in: The Evolution and Fate of + Super-Chandrasekhar Mass White Dwarf Merger Remnants + http://arxiv.org/pdf/1606.02300.pdf + +* GNU Parallel was cited in: Evaluation of Coastal Scatterometer + Products + https://mdc.coaps.fsu.edu/scatterometry/meeting/docs/2016/Thu_AM/coastal-poster.pdf + +* GNU Parallel was used in: https://github.com/splitice/bulkdnsblcheck + +* The iconv slurp misfeature + http://www.openfusion.net/linux/iconv_slurp_misfeature + +* แบบว่า CPU เหลือ https://veer66.wordpress.com/2016/06/15/gnu-parallel/ + +* Bug fixes and man page updates. + + +20160622 + +* $PATH can now be exported using --env PATH. Useful if GNU Parallel + is not in your path on remote machines. + +* If --block is left out, --pipepart will use a block size that will + result in 10 jobs per jobslot. + +* The cookie from 2016-01-04 was won by Morgan Rodgers on the + 2016-06-06 after 5 months. + +* Vote for GNU Parallel's community ad on + https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046 + +* GNU Parallel was cited in: Genotypic Resistance Tests Sequences + Reveal the Role of Marginalized Populations in HIV-1 Transmission in + Switzerland http://www.nature.com/articles/srep27580 + +* GNU Parallel was cited in: A Deep-Learning Approach for Operation of + an Automated Realtime Flare Forecast + https://arxiv.org/pdf/1606.01587.pdf + +* Unix parallel: Populating all the USB sticks + http://www.markhneedham.com/blog/2016/06/01/unix-parallel-populating-all-the-usb-sticks/ + +* GNU Parallel is a fantastic utility https://www.dray.be/parallel/ + +* Combining a large number of VCF files + https://gtamazian.com/2016/06/16/combining-a-large-number-of-vcf-files/ + +* Useful Scraping Techniques + http://blog.apps.npr.org/2016/06/17/scraping-tips.html + +* Tools of the trade + http://onox.com.br/2015/05/tools-of-the-trade/#more-198 + +* Armslist scraper https://github.com/nprapps/armslist-scraper/ + +* Bug fixes and man page updates. + + +20160522 + +* niceload --net pauses the program if the internet connection is + overloaded. + +* Vote for GNU Parallel's community ad on + https://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046 + +* Updated speed comparison between versions + https://www.gnu.org/software/parallel/process-time-j2-1700MHz-3000-1000.pdf + +* GNU Parallel was cited in: Improving computation efficiency by + parallel programming + http://www.irbis-nbuv.gov.ua/cgi-bin/irbis_nbuv/cgiirbis_64.exe?C21COM=2&I21DBN=UJRN&P21DBN=UJRN&IMAGE_FILE_DOWNLOAD=1&Image_file_name=PDF/ape_2013_3_44.pdf + +* GNU Parallel was cited in: A supernova feedback implementation for + the astrophysical simulation software Arepo + https://arxiv.org/abs/1604.06071 + +* GNU Parallel was cited in: Lorenz-Mie theory for 2D scattering and + resonance calculations https://arxiv.org/pdf/1505.07691v2.pdf + +* GNU Parallel was cited in: Host-pathogen co-evolution and the + emergence of broadly neutralizing antibodies in chronic infections + https://arxiv.org/abs/1512.06296 + +* GNU Parallel was cited in: Pacific People, Metabolic Disease and + Evolutionary Processes: a mitochondrial DNA study + https://otago.ourarchive.ac.nz/handle/10523/6340 + +* GNU Parallel was cited in: The effect of domain modeling on + efficiency of planning: Lessons from the Nomystery domain + http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7407131 + +* GNU Parallel was cited in: Oops, my tests broke the build: An + analysis of Travis CI builds with GitHub + https://peerj.com/preprints/1984/ + +* GNU Parallel was cited in: Drosophila Muller F Elements Maintain a + Distinct Set of Genomic Properties Over 40 Million Years of + Evolution http://www.g3journal.org/content/5/5/719.full.pdf+html + +* GNU Parallel was cited in: An Empirical Comparison of Neural + Architectures for Reinforcement Learning in Partially Observable + Environments + http://biorxiv.org/content/biorxiv/early/2016/03/24/022707.full.pdf + +* GNU Parallel was cited in: PleaseTM: Enabling Transaction Conflict + Management in Requester-wins Hardware Transactional Memory + http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7446072 + +* GNU Parallel was cited in: EASE-MM: Sequence-Based Prediction of + Mutation-Induced Stability Changes with Feature-Based Multiple + Models + http://www.sciencedirect.com/science/article/pii/S0022283616000310 + +* GNU Parallel was cited in: A new orthology assessment method for + phylogenomic data: Unrooted Phylogenetic Orthology + http://mbe.oxfordjournals.org/content/early/2016/04/06/molbev.msw069.short + https://github.com/ballesterus/UPhO + +* GNU Parallel was cited in: Distinctive Interest Point Selection for + Efficient Near-duplicate Image Retrieval + http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7459172 + +* GNU Parallel was cited in: The Evolution of C Programming Practices: + A Study of the Unix Operating System 1973–2015 + https://dl.acm.org/citation.cfm?id=2884799 (It has the cutest + thumbnail graphs I have ever seen scattered all over the text) + +* GNU Parallel was cited in: Data processing pipeline for serial + femtosecond crystallography at SACLA + http://journals.iucr.org/j/issues/2016/03/00/zw5001/index.html + +* GNU Parallel was cited in: Reconstruction of Fine-Scale Auroral + Dynamics http://arxiv.org/pdf/1512.01460.pdf + +* GNU Parallel was cited in: Genomic legacy of the African cheetah, + Acinonyx jubatus + https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4676127/pdf/13059_2015_Article_837.pdf + +* GNU Parallel was cited in: Don’t Forget to Lock the Back Door! A + Characterization of IPv6 Network Security Policy + http://benign-research-probe2.eecs.umich.edu/ndss16_ipv6_final.pdf + +* GNU Parallel was cited in: Comprehensive Annotation of the + Parastagonospora nodorum Reference Genome Using Next-Generation + Genomics, Transcriptomics and Proteogenomics + http://journals.plos.org/plosone/article/asset?id=10.1371%2Fjournal.pone.0147221.PDF + +* GNU Parallel was cited in: How attention influences perceptual + decision making: Single-trial EEG correlates of drift-diffusion + model parameters http://www.cidlab.com/prints/nunez2016attention.pdf + +* GNU Parallel was cited in: Telomere And Proximal Sequence Analysis + Using High-Throughput Sequencing Reads + http://repository.upenn.edu/edissertations/1460/ + +* GNU Parallel was cited in: AT-GIS: Highly Parallel Spatial Query + Processing with Associative Transducers + http://lsds.doc.ic.ac.uk/sites/default/files/ATGIS-SIGMOD16.pdf + +* GNU Parallel was cited in: PVAIR: Partial Variable Assignment + InterpolatoR http://verify.inf.usi.ch/sites/default/files/main-2.pdf + +* GNU Parallel was cited in: Comparative Cladistics: Fossils, + Morphological Data Partitions and Lost Branches in the Fossil Tree + of Life http://opus.bath.ac.uk/43955/ + +* GNU Parallel was cited in: Shannon: An Information-Optimal de + NovoRNA-Seq Assembler + http://biorxiv.org/content/biorxiv/early/2016/02/09/039230.full.pdf + +* GNU Parallel was cited in: Adaptive Measure-Theoretic Parameter + Estimation for Coastal Ocean Modeling + https://repositories.lib.utexas.edu/handle/2152/32435 + +* GNU Parallel was cited in: Computational Design of DNA-Binding + Proteins + http://link.springer.com/protocol/10.1007/978-1-4939-3569-7_16 + +* GNU Parallel was cited in: Reference genotype and exome data from an + Australian Aboriginal population for health-based research + http://www.nature.com/articles/sdata201623 + +* GNU Parallel was cited in: Do aye-ayes echolocate? + http://biorxiv.org/content/biorxiv/early/2016/04/11/048165.full.pdf + +* GNU Parallel was cited in: Functional enrichments of disease + variants across thousands of independent loci in eight diseases + http://biorxiv.org/content/biorxiv/early/2016/04/11/048066.full.pdf + +* GNU Parallel was cited in: From genomes to phenotypes: Traitar, the + microbial trait analyzer + http://biorxiv.org/content/biorxiv/early/2016/03/12/043315.full.pdf + +* GNU Parallel was mentioned in: Fast Playback Framework for Analysis + of Ground-Based Doppler Radar Observations Using MapReduce + Technology + http://journals.ametsoc.org/doi/pdf/10.1175/JTECH-D-15-0118.1 + +* NCBI blast tutorial + https://github.com/enormandeau/ncbi_blast_tutorial + +* Distributed Preservation Made Simple + https://blog.archive.org/2016/02/26/distributed-preservation-made-simple/ + +* Parallel Jobs in Luigi http://rjbaxley.com/posts/2016/03/13/parallel_jobs_in_luigi.html + +* Bug fixes and man page updates. + + +20160422 + +* :::+ and ::::+ work like ::: and :::: but links this input source to + the previous input source in a --xapply fashion. Contrary to + --xapply values do not wrap: The shortest input source determines + the length. + +* --line-buffer --keep-order now outputs continously from the oldest + job still running. This is more what you would expect than the + earlier behaviour where --keep-order had no effect with + --line-buffer. + +* env_parallel supports tcsh, csh, pdksh. In fish it now supports + arrays. In csh/tcsh it now supports variables, aliases, and arrays + with no special chars. In pdksh it supports aliases, functions, + variables, and arrays. + +* Function exporting on Mac OS X works around old Bash version. + +* Better CPU detection on OpenIndiana. + +* GNU Parallel was cited in: Automatic Methods for Assisted + Recruitment + https://www.researchgate.net/publication/297738658_Automatic_Methods_for_Assisted_Recruitment + +* GNU Parallel was cited in: Reinterpretation of ATLAS 8 TeV searches + for Natural SUSY with a R-Sneutrino LSP + http://arxiv.org/pdf/1603.06130.pdf + +* GNU Parallel was cited in: An Operational Radiometric Landsat + Preprocessing Framework for Large-Area Time Series Applications + https://www.uni-trier.de/fileadmin/fb6/prof/FER/Publikationen/frantz_et_al_ieee-tgrs-2016-post-print.pdf + +* A basic demo of how GNU Parallel can speed up execution of commands + https://www.youtube.com/watch?v=kl8LO2jcvMc + +* qbatch uses GNU Parallel: https://pypi.python.org/pypi/qbatch/1.0rc2 + +* FaceCrop uses GNU Parallel: https://github.com/EderSantana/FaceCrop + +* Parallel Processing with Catmandu + https://librecatproject.wordpress.com/2016/04/20/parallel-processing-with-catmandu/ + +* GNU parallel 應用範例 + http://staypython.blogspot.dk/2016/04/gnu-parallel.html + +* Bug fixes and man page updates. + + +20160322 + +* env_parallel is a function that exports the environment (functions, + aliases, variables, and arrays) to GNU Parallel. Run 'man + env_parallel' for details. + +* niceload --prg now searches for substrings if no process with the + name is found. + +* GNU Parallel was cited in: Random Forest DBSCAN for USPTO Inventor + Name Disambiguation http://arxiv.org/pdf/1602.01792.pdf + +* GNU Parallel was mentioned (with wrong citation) in: Dual Level + Parallel Computations for LargeScale High-Fidelity Database to + Design Aerospace Vehicles + http://www.nas.nasa.gov/assets/pdf/papers/Guruswamy_2013_DualLevelParallelComputations.pdf + +* Using ‘Parallel’ in Unix + https://shearnrylan.wordpress.com/2016/02/22/using-parallel-in-unix/ + +* JPEG Squish uses (and co-distributes) GNU Parallel: + http://dantidswell.co.uk/jpeg-squish/ + +* Bug fixes and man page updates. + + +20160222 + +* Vote for new community on Superuser, Ask Ubuntu, Unix&Linux + http://meta.superuser.com/questions/11127/community-promotion-ads-2016/11225#11225 + http://meta.askubuntu.com/questions/14925/community-promotion-ads-2016/15046#15046 + http://meta.unix.stackexchange.com/questions/3854/community-promotion-ads-2016/3893#3893 + +* Daily Quick Tip: parallel + https://medium.com/@jacaetevha/daily-quick-tip-parallel-8772435f6582 + +* Downloading a list of URLs + http://blog.gypsydave5.com/2016/02/04/xargs-and-curl/ + +* Using GNU Parallel and ImageMagick for Conversions + http://blog.fractalcomic.com/tutorials/using-gnu-parallel-and-imagemagick-for-conversions/ + +* Running bash commands in parallel + http://linuxcommando.blogspot.dk/2016/01/running-bash-commands-in-parallel.html + +* parallel processing in PDAL + https://smathermather.wordpress.com/2016/01/28/parallel-processing-in-pdal/ + +* A Million Text Files And A Single Laptop + http://randyzwitch.com/gnu-parallel-medium-data/ + +* 「今日から使い切る」ための GNU Parallelによる並列処理入門 + http://www.slideshare.net/koji_matsuda/gnu-parallel + +* Bug fixes and man page updates. + + +20160122 + +* --sql DBURL uses DBURL as storage for jobs and output. It does not + run any jobs so it requires at least one --sqlworker. DBURL must + point to a table. + +* --sqlworker DBURL gets jobs from DBURL and stores the result back to + DBURL. + +* --sqlandworker is a shorthand for --sql and --sqlworker. + +* --sqlworker requires the output of a single job to fit in memory. + +* --results now also saves a file called 'seq' containing the sequence + number. + +* If $PARALLEL_ENV is a file, then that file will be read into + $PARALLEL_ENV. + +* man parallel_tutorial has been given an overhaul. + +* --workdir now accepts replacementstrings. + +* GNU Parallel was cited in: Possum - A Framework for + Three-Dimensional Reconstruction of Brain Images from Serial + Sections http://link.springer.com/article/10.1007/s12021-015-9286-1 + +* GNU Parallel was cited in: A Genetic Algorithm for the selection of + structural MRI features for classification of Mild Cognitive + Impairment and Alzheimer's Disease + http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=7359909&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7359909 + +* GNU Parallel was cited in: The Effect of Domain Modeling on + Performance of Planning Algorithms + http://isaim2016.cs.virginia.edu/papers/ISAIM2016_Bartak_Vodrazka.pdf + +* Plotting time tables for jobs run by GNU Parallel + https://github.com/ziotom78/plot_joblog + +* GNU Parallel was used in: Mission Impossible: you have 1 minute to + analyze the Ebola Genome https://www.biostars.org/p/119397 + +* GNU Parallel is used in LAST: http://last.cbrc.jp/ + +* Distributed Log Search Using GNU Parallel + http://codehate.com/blog/2015/12/01/distributed-log-search-using-gnu-parallel/ + +* Bug fixes and man page updates. + + +20151222 + +* --transfer is now an alias for --transferfile {}. + +* --transferfile works like --transfer, but takes an argument like + --return. This makes it possible to combine transferring files + with multiple input sources: parallel -S server --tf {1} wc {2} + {1} ::: * ::: -l -w -c + +* total_jobs() can now be used in {= =}: parallel echo job {#} of '{= + $_=total_jobs() =}' ::: {1..50} + +* GNU Parallel was cited in: Evolution and Learning in Heterogeneous + Environments + http://research.gold.ac.uk/15078/1/COM_thesis_JonesD_2015.pdf + +* GNU Parallel was cited in: Achieving Consistent Doppler Measurements + from SDO/HMI Vector Field Inversions + http://arxiv.org/pdf/1511.06500.pdf + +* Flo uses GNU Parallel: https://github.com/wurmlab/flo + +* 使用 GNU parallel 來平行運算 + http://mutolisp.logdown.com/posts/316959-using-gnu-parallel-to-parallel-computing + +* Bug fixes and man page updates. + + +20151122 + +* GNU Parallel packaged for CERN CentOS: + http://linuxsoft.cern.ch/cern/centos/7/cern/x86_64/repoview/parallel.html + +* GNU Parallel was cited in: The Outer Solar System Origins Survey: + I. Design and First-Quarter Discoveries + http://arxiv.org/pdf/1511.02895.pdf + +* GNU Parallel was cited in: Contrasting genetic architectures of + schizophrenia and other complex diseases using fast + variance-components analysis + http://www.nature.com/ng/journal/vaop/ncurrent/full/ng.3431.html + +* GNU Parallel was cited in: Named-Entity Chunking for Norwegian Text + using Support Vector Machines + http://ojs.bibsys.no/index.php/NIK/article/viewFile/248/211 + +* GNU Parallel was cited in: Multiscale Estimation of Binding Kinetics + Using Brownian Dynamics, Molecular Dynamics and Milestoning + http://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1004381#pcbi.1004381.ref072 + +* GNU Parallel was cited in: A Detailed Characterization of Errors in + Logic Circuits due to Single-Event Transients + http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=7302348&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D7302348 + +* GNU Parallel was cited in: Arabic Speaker Emotion Classification + Using Rhythm Metrics and Neural Networks + http://www.eurasip.org/Proceedings/Eusipco/Eusipco2015/papers/1570104855.pdf + +* GNU Parallel was cited in: Stride Search: a general algorithm for + storm detection in high resolution climate data + http://www.geosci-model-dev-discuss.net/8/7727/2015/gmdd-8-7727-2015.pdf + +* GNU Parallel was cited in: Decomposing Digital Paintings into Layers + via RGB-space Geometry http://arxiv.org/pdf/1509.03335.pdf + +* GNU Parallel was cited in: Structure and evolutionary history of a + large family of NLR proteins in the zebrafish + http://www.biorxiv.org/content/biorxiv/early/2015/09/18/027151.full.pdf + +* GNU Parallel was cited in: Evolution of movement strategies under + competitive interactions + http://digital.csic.es/bitstream/10261/115973/1/evolution_movement_strategies_Kiziridis.pdf + +* Automating large numbers of tasks + https://rcc.uchicago.edu/docs/tutorials/kicp-tutorials/running-jobs.html + +* Max out your IOPs with GNU Parallel + http://blog.bitratchet.com/2015/11/11/max-out-your-iops-with-gnu-parallel/ + +* Bug fixes and man page updates. + + +20151022 + +* --plus makes it possible to use {##} as a shorthand for + {= $_=$Global::JobQueue->total_jobs() =} which gives the the number + of jobs to run in total. + +* {= $_=$Global::JobQueue->total_jobs() =} is incompatible with -X, + -m, and --xargs. + +* GNU Parallel is now mostly compatible with lsh + (http://www.lysator.liu.se/~nisse/lsh/) and somewhat compatible with + autossh (http://www.harding.motd.ca/autossh/). + +* --workdir ... now also works when run locally. + +* GNU Parallel was cited in: There is no (75, 32, 10, 16) strongly + regular graph http://arxiv.org/pdf/1509.05933.pdf + +* GNU Parallel was cited in: Roary: rapid large-scale prokaryote pan + genome analysis + http://bioinformatics.oxfordjournals.org/content/early/2015/08/05/bioinformatics.btv421.full.pdf+html + +* GNU Parallel is used in TraitAR: + https://testpypi.python.org/pypi/traitar/0.1.4 + +* A parallel and fast way to download multiple files + http://onetipperday.blogspot.com/2015/10/a-parallel-and-fast-way-to-download.html + +* Usar GNU Parallel para aumentar el rendimiento de tus scripts + http://adrianarroyocalle.github.io/blog/2015/10/20/usar-gnu-parallel/ + +* Bug fixes and man page updates. + + +20150922 + +* GNU Parallel was cited in: Flexible Modeling of Epidemics with an + Empirical Bayes Framework + http://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1004382 + +* GNU Parallel was cited in: BL1: 2D Potts Model with a Twist + https://sucs.swan.ac.uk/~rjames93/Dissertation.pdf + +* GNU Parallel was cited in: A Scalable Parallel Implementation of + Evolutionary Algorithms for Multi-Objective Optimization on GPUs + http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7257074 + +* GNU Parallel was cited in: How Can We Measure the Similarity Between + Résumés of Selected Candidates for a Job? + https://www.researchgate.net/publication/275954089_How_can_we_measure_the_similarity_between_rsums_of_selected_candidates_for_a_job + +* GNU Parallel was cited in: Interplay of cell dynamics and epithelial + tension during morphogenesis of the Drosophila pupal wing + http://www.researchgate.net/profile/Raphael_Etournay/publication/279061859_Interplay_of_cell_dynamics_and_epithelial_tension_during_morphogenesis_of_the_Drosophila_pupal_wing/links/558a95ad08aeae8413bcceea.pdf + +* Third-party selling GNU Parallel T-shirts + http://www.aliexpress.com/item/2015F-BSO-GNU-LOGO-GNU-PARALLEL-men-s-shirt-sleeve-visual-illusion-error/32464827966.html + +* Joys of gnu parallel + http://scottolesen.com/index.php/2015/08/26/joys-of-gnu-parallel/ + +* Crop and resize images with bash and ImageMagick + https://www.simonholywell.com/post/2015/08/image-resize-crop-bash-imagemagick/ + +* Three Ways to Script Processes in Parallel + http://www.codeword.xyz/2015/09/02/three-ways-to-script-processes-in-parallel/ + +* What It Looks Like to Process 3.5 Million Books + http://blog.gdeltproject.org/what-it-looks-like-to-process-3-5-million-books/ + +* Bug fixes and man page updates. + + +20150822 + +* If $job->skip() is called in {= =} the job will not be run. + +* @arg can now be used in {= =}: parallel echo '{= $arg[2] < 5 and + $_="j" =}' ::: 1 2 3 ::: 4 5 6 + +* Version of GNU Parallel that uses PostgreSQL as backend + https://github.com/stephen-fralich/parallel-sql/ + +* SpeedSeq: ultra-fast personal genome analysis and interpretation + http://www.nature.com/nmeth/journal/vaop/ncurrent/full/nmeth.3505.html + +* GNU Parallel is used in elPrep: https://github.com/ExaScience/elprep + +* Who actually reads the code? + http://www.fsf.org/blogs/community/who-actually-reads-the-code + +* Introduction to GNU Parallel + http://erictleung.com/2015/08/06/intro-to-gnu-parallel/ + +* ¿Alguien se lee el código? + http://www.taringa.net/post/linux/18854759/Alguien-se-lee-el-codigo.html + +* ¿Quién se lee el código fuente? + https://victorhckinthefreeworld.wordpress.com/2015/08/12/quien-se-lee-el-codigo-fuente/ + +* Distribution des traitements avec GNU Parallel + http://blog.inovia-conseil.fr/?p=226#4 + +* Эксперимент по проверке, читают ли код открытых проектов + http://www.opennet.ru/opennews/art.shtml?num=42718 + +* 多核心主機搭配 GNU parallel + http://blog.zeroplex.tw/2015/08/gnu-parallel.html + +* Bug fixes and man page updates. + + +20150722 + +* If a record fits in a block, --block only reads upto the size of + --block. If not: --block reads a full --block more. + +* Due to widely spread distributions still using --tollef even after a + year of being retired following a year of being obsolete, --tollef + now gives an error unless used with --gnu. + +* --nice now uses a perl wrapper instead of the nice command. + +* Cookie 2013-08-18 was won by Mark Maimone, 1 year and 11 months + after release. + +* A parser for GNU Parallel --joblog files: + https://github.com/harryjubb/joblog + +* GNU Parallel was cited in: Dynamical formation & scattering of + hierarchical triples: Cross sections, Kozai-Lidov oscillations, and + collisions http://arxiv.org/pdf/1507.03593.pdf + +* GNU Parallel was cited in: A Fast Compiler for NetKAT + http://arxiv.org/pdf/1506.06378.pdf + +* GNU Parallel was cited in: Decomposing Time-Lapse Paintings into + Layers + http://cs.gmu.edu/~ygingold/timemap/Decomposing%20Time-Lapse%20Paintings%20into%20Layers%20(Tan%20et%20al%202015%20SIGGRAPH)%20600dpi.pdf + +* GNU Parallel was used in: Somatic mutation calling from the matched + tumor-normal exome-sequencing + http://fafner.meb.ki.se/biostatwiki/somac/ + +* Parallel Processing from the Command Line + https://www.perpetual-beta.org/weblog/parallel-processing-from-the-command-line.html + +* Using GNU Parallel to speed up network operations + http://vielmetti.typepad.com/vacuum/2015/06/using-gnu-parallel-to-speed-up-network-operations.html + +* Crawl faster with "parallel" - but how fast? + http://andreas-wpv.blogspot.com/2015/07/crawl-faster-with-parallel-but-how-fast.html + +* Simultaneously benchmark many URLs with ApacheBench and GNU parallel + https://www.simonholywell.com/post/2015/06/parallel-benchmark-many-urls-with-apachebench/ + +* Bug fixes and man page updates. + + +20150622 + +* --halt has been rewritten completely. You can now combine + percentages with success or fail. See the man page. + +* Exit values 102..254 have been removed. 101 means more than 100 jobs + failed. + +* Killing through --timeout, --memfree, or --halt is now done as a + process group. + +* --termseq determines which signals are sent when a job is killed. + +* An empty argument would previously cause no string to be + inserted. This is now changed to '' being inserted, thus prepending + a space to the output of: parallel echo {} b ::: '' + +* $PARALLEL_ENV can now be set to an environment prepending the + command. Used in env_parallel as mentioned in the manpage. + +* --retry-failed will retry all failed jobs in a joblog. It will + ignore any command given. + +* --ssh and $PARALLEL_SSH can be used to set the command used for + ssh. The command is assumed to behave the same way as ssh. + +* --fifo now works in csh, too. + +* Q(...) can be used in {= =} to shell quote a string. + +* GNU Parallel was cited in: DockBench: An Integrated Informatic + Platform Bridging the Gap between the Robust Validation of Docking + Protocols and Virtual Screening Simulations + http://www.mdpi.com/1420-3049/20/6/9977 + +* GNU Parallel was cited in: Swedes Online: You Are More Tracked Than + You Think + http://www.diva-portal.org/smash/get/diva2:807623/FULLTEXT01.pdf + +* GNU Parallel was cited in: Tutorial: Lorenz-Mie theory for 2D + scattering and resonance calculations + http://arxiv.org/pdf/1505.07691.pdf + +* GNU Parallel was cited in: A quantitative assessment of the Hadoop + framework for analyzing massively parallel DNA sequencing data + http://link.springer.com/article/10.1186/s13742-015-0058-5 + +* GNU Parallel was cited in: A composite genome approach to identify + phylogenetically informative data from next-generation sequencing + http://www.biomedcentral.com/content/pdf/s12859-015-0632-y.pdf + +* GNU Parallel is used in: taxator-tk + http://algbio.cs.uni-duesseldorf.de/webapps/wa-download/ + +* GNU Parallel is used in: https://github.com/d2207197/local-mapreduce + +* GNU Parallel is used in: wiki-edit-news https://github.com/albert-decatur/wiki-edit-news + +* GNU Parallel is used in: A Fingerprint Identification System + https://curve.carleton.ca/system/files/theses/28733.pdf + +* Job ad asking for GNU Parallel experience: + http://searchjobs.intel.com/gdansk-pol/software-validation-engineer/63A06826DAF24797AB414DC146201C2E/job/ + +* Using BLAT http://wangzhengyuan.blogspot.dk/2015/06/using-blat.html + +* Bug fixes and man page updates. + + +20150522 + +* Security: The security issue for --sshlogin + --fifo/--cat has been + fixed. Thereby all issues with + http://lists.gnu.org/archive/html/parallel/2015-04/msg00045.html + have been fixed. + +* Security: After further security analysis the issue fixed in + 20150422 also fixed the problem for --tmux. + +* GNU Parallel was cited in: CIDER: a pipeline for detecting waves of + coordinated transcriptional regulation in gene expression + time-course data + http://biorxiv.org/content/biorxiv/early/2015/03/17/012518.full.pdf + +* GNU Parallel was cited in: Building Genomic Analysis Pipelines in a + Hackathon Setting with Bioinformatician Teams: DNA-seq, Epigenomics, + Metagenomics and RNA-seq + http://biorxiv.org/content/biorxiv/early/2015/05/05/018085.full.pdf + +* GNU Parallel was cited in: Sequencing the cap-snatching repertoire + of H1N1 influenza provides insight into the mechanism of viral + transcription initiation + http://nar.oxfordjournals.org/content/early/2015/04/20/nar.gkv333.full.pdf + +* GNU Parallel was cited in: Genome assembly using Nanopore-guided + long and error-free DNA reads + http://www.biomedcentral.com/content/pdf/s12864-015-1519-z.pdf + +* GNU Parallel was used (unfortunately with wrong citation) in: + Comparing the CarbonTracker and TM5-4DVar data assimilation systems + for CO2 surface flux inversions + http://www.atmos-chem-phys-discuss.net/15/8883/2015/acpd-15-8883-2015-discussion.html + +* GNU Parallel was used in: Gene Set Omic Analysis (GSOA) method + https://bitbucket.org/srp33/gsoa + +* A Quick and Neat :) Orchestrator using GNU Parallel + http://www.elsotanillo.net/2015/05/a-quick-and-neat-orchestrator-using-gnu-parallel/ + +* Execute commands on multiple computers using GNU Parallel (setting + up a cluster on the cheap) + https://spectraldifferences.wordpress.com/2015/04/26/execute-commands-on-multiple-computers-using-gnu-parallel-setting-up-a-cluster-on-the-cheap/ + +* Functions and GNU parallel for effective cluster load management + http://genomespot.blogspot.dk/2015/04/functions-and-gnu-parallel-for.html + +* Use parallel processing to save time importing databases + http://drupalsun.com/node/41854 + +* Run multiple ssh commands in parallel with GNU Parallel + http://www.ameir.net/blog/archives/380-run-multiple-ssh-commands-in-parallel-with-gnu-parallel.html + +* Importing huge databases faster + https://www.lullabot.com/blog/article/importing-huge-databases-faster + +* Parallel? Gnu parallel! https://debian.pro/1834 + +* Bug fixes and man page updates. + + +20150422 + +New in this release: + +* Security fix. An attacker on the local system could make you + overwrite one of your own files with a single byte. The problem + exist when you use --compress or --tmux or --pipe or --cat or + --fifo. The attacker must figure out the randomly chosen file name + and create a symlink within a time window of 15 ms. + +* --shuf will generate all jobs, and shuffle them before running + them. This is useful to get a quick preview of the results before + running the full batch. + +* GNU Parallel now has a DOI: https://dx.doi.org/10.5281/zenodo.16303 + +* GNU Parallel was cited in: Scaling Machine Learning for Target + Prediction in Drug Discovery using Apache Spark + https://cris.cumulus.vub.ac.be/portal/files/5147244/spark.pdf + +* GNU Parallel was cited in: Bayesian inference of protein structure + from chemical shift data https://peerj.com/articles/861/ + +* GNU Parallel was cited in: Toward Enhanced Metadata Quality of + Large-Scale Digital Libraries: Estimating Volume Time Range + https://www.ideals.illinois.edu/bitstream/handle/2142/73656/186_ready.pdf + +* GNU Parallel was cited in: Experimental study on the Wind Farm + Substation Cable Installation Problem + http://i11www.iti.uni-karlsruhe.de/_media/teaching/theses/ma-schmitz-14.pdf + +* GNU Parallel was used in: https://github.com/KAPPS-/landsat-gifworks + +* GNU Parallel was used in: https://github.com/exascience/elprep + +* GNU Parallel was used in: + http://search.cpan.org/~jillrowe/HPC-Runner-GnuParallel-0.01/ + +* GNU Parallel was used in: + http://search.cpan.org/~ajpage/Bio-Roary-2.0.7/lib/Bio/Roary/JobRunner/Parallel.pm + +* GNU Parallel was used in: Rapid haploid SNP calling + https://github.com/tseemann/snippy + +* Pictures and Metadata + http://www.ozzy.no/2015/02/05/pictures-and-metadata/ + +* Task automation with bash and parallel + https://biowize.wordpress.com/2015/03/23/task-automation-with-bash-and-parallel/ + +* How To: Speed Up File Transfers in Linux using RSync with GNU + Parallel + http://www.yourownlinux.com/2015/04/speed-up-file-transfers-using-rsync-with-gnu-parallel.html + +* Mirroring a Git Repository + https://avacariu.me/articles/mirroring-a-git-repository.html + +* Add an ENVI header to JAXA Global Mangrove Watch PALSAR tiles + https://spectraldifferences.wordpress.com/2015/03/24/add-an-envi-header-to-jaxa-global-mangrove-watch-palsar-tiles/ + +* 你见过的最牛逼的命令行程序是什么？ + http://www.zhihu.com/question/29257300 + +* Bug fixes and man page updates. + + +20150322 + +New in this release: + +* --number-of-cores respects 'taskset' on GNU/Linux. + +* --joblog --pipe gives the data send and received in the log. + +* GNU Parallel was tested to support 100 GB sized records in --pipe. A + few bugs was fixed to support >2 GB records. It works, but is rather + slow. + +* GNU Parallel was cited in: RIG: Recalibration and Interrelation of + genomic sequence data with the GATK + http://www.g3journal.org/content/early/2015/02/13/g3.115.017012.full.pdf+html + +* GNU Parallel was cited in: MPI-blastn and NCBI-TaxCollector: + Improving metagenomic analysis with high performance classification + and wide taxonomic attachment + http://www.worldscientific.com/doi/abs/10.1142/S0219720014500139?af=R& + +* GNU Parallel was cited in: Recent evolution in Rattus norvegicus is + shaped by declining effective population size + http://biorxiv.org/content/biorxiv/early/2015/03/01/015818.full.pdf + +* GNU Parallel was cited in: Evidence for DCO+ as a probe of + ionization in the warm disk surface + http://arxiv.org/pdf/1503.02659.pdf + +* GNU Parallel was cited in: De novo assembly and annotation of the + Asian tiger mosquito (Aedes albopictus) repeatome with dnaPipeTE + from raw genomic reads and comparative analysis with the yellow + fever mosquito (Aedes aegypti) + http://gbe.oxfordjournals.org/content/early/2015/03/11/gbe.evv050.full.pdf + +* GNU Parallel was cited in: A General Approach to Network + Configuration Analysis + http://research.microsoft.com/en-us/um/people/ratul/papers/nsdi2015-batfish.pdf + +* GNU Parallel was cited in: Scrimer: designing primers from + transcriptome data + http://onlinelibrary.wiley.com/doi/10.1111/1755-0998.12403/pdf + +* GNU Parallel was cited in: Efficient Retrieval of Key Material for + Inspecting Potentially Malicious Traffic in the Cloud + http://sacko.uk/pdf/2015.1.pdf + +* GNU Parallel will be presented at Strataconf: Poor Man's Parallel + Pipelines + http://strataconf.com/big-data-conference-uk-2015/public/schedule/detail/40031 + +* GNU Parallel was used in: + https://github.com/alexbyrnes/FCC-Political-Ads_The-Code + +* GNU Parallel was used in: https://github.com/martymac/fpart + +* GNU Parallel was used in: + https://github.com/hoytak/diabetic-retinopathy-code + +* GNU Parallel was used in: + https://github.com/mehmattski/HybSeqPipeline + +* GNU Parallel was used in: + http://search.cpan.org/~ajpage/Bio-Roary-2.0.0/lib/Bio/Roary/JobRunner/Parallel.pm + +* Using GNU Parallel on a Raspberry Pi cluster: + http://www.dcglug.org.uk/cluster-progress/ + +* An introduction to vector tiling and map reduce in postgis: + http://dimensionaledge.com/intro-vector-tiling-map-reduce-postgis/ + +* Running scripts in parallel with GNU Parallel: + http://code.jasonbhill.com/2015/03/ + +* Mahout: Parallelising the creation of DecisionTrees: + http://www.markhneedham.com/blog/2012/12/27/mahout-parallelising-the-creation-of-decisiontrees/ + +* High-Performance Scientific Computing: Running serial jobs in + parallel + https://support.scinet.utoronto.ca/education/staticpublic/course178/serial.pdf + +* Parallel cardinality on your laptop + https://highonscience.wordpress.com/2015/03/15/parallel-cardinality-on-your-laptop/ + +* Experiments about a better locate using grep + http://a3nm.net/blog/better_locate.html + +* Homework with GNU Parallel: + https://support.scinet.utoronto.ca/education/staticpublic/course178content349.html + +* Parallel - Jobs in Skripten parallelisieren: + https://slzm.de/blog/linux-tool-des-tages-parallel-jobs-in-skripten-parallelisieren/#more-612 + +* GNU Parallel, czyli 100% użycia procesora + http://matmatyk.blogspot.dk/2015/03/gnu-parallel-czyli-100-uzycia-procesora.html + +* Bug fixes and man page updates. + + +20150222 + +* --tmux has gotten a major overhaul. + +* GNU Parallel was cited in: RaftLib: A C++ Template Library for High + Performance Stream Parallel Processing + http://www.cs.wustl.edu/~lip/pubs/pmam15_jbeard.pdf + +* GNU Parallel was cited in: Quantifying properties of hot and dense + QCD matter through systematic model-to-data comparison + http://arxiv.org/pdf/1502.00339.pdf + +* GNU Parallel was cited in: Towards Collaborative Exploration and + Analysis of Big Data from Mars: A Noachis Terra Case Study + http://link.springer.com/chapter/10.1007/978-3-319-13865-7_25 + +* GNU Parallel was used (unfortunately with wrong citation) in: + Performance and Scaling Comparison Study of RDBMS and NoSQL + (MongoDB) + http://ijact.in/wp-content/uploads/2014/11/COMPUSOFT-311-1270-1275.pdf + +* GNU Parallel was used (unfortunately without citation) in: Parallel + Implementation of Big Data Pre-Processing Algorithms for Sentiment + Analysis of Social Networking Data + http://www.researchmathsci.org/IJFMAart/ijfma-v6n2-7.pdf + +* GNU Parallel was used (unfortunately without citation) in: SpeedSeq: + Ultra-fast personal genome analysis and interpretation + http://biorxiv.org/content/biorxiv/early/2014/12/05/012179.full.pdf + +* Zip Folders with GNU Parallel + http://fazky.github.io/posts/Linux/2015-01-07-GNU-Parallel.html + +* Using GNU Parallel with Freesurfer + http://programminginadarkroom.blogspot.dk/2015/02/using-gnu-parallel-with-freesurfer.html + +* GNU Parallel is used in Velociraptor: https://github.com/ericwhyne/Velociraptor + +* Marcus Beach GNU Parallel http://marcusbeach.co/gnu-parallel/ + +* Bug fixes and man page updates. + + +20150122 + +* Remote jobs now send stderr (standard error) to stderr (standard + error) instead of stdout (standard output). + +* Remote execution command is now packed using base64 encoded + bzip2. This means that big environments (app. 100 KB) can be + transferred. This change makes remote execution alpha quality. + +* --semaphoretimeout now takes a negative value. This means give up if + the semaphore is not gotten within the timeout. + +* --halt -1 and -2 now means halt if a job succeeds (so the opposite + of 1 and 2). + +* --no-keep-order will reverse --keep-order. + +* Bash's second fix of shellshock caused --env to break again when + exporting functions. This has been fixed again. + +* A semibig refactoring of big functions. All non-trivial functions + are now less than 100 lines. The refactoring makes this release beta + quality. + +* A description of the design decisions for GNU Parallel can be found + in 'man parallel_design'. + +* A bug fix in replacement strings caused rewrite of the replacement + function. This makes use of replacement strings alpha quality. + +* GNU Parallel was cited in: Improving Energy and Performance with + Spintronics Caches in Multicore Systems + http://link.springer.com/chapter/10.1007/978-3-319-14313-2_24 + +* GNU Parallel was cited in: Parallel post-processing with MPI-Bash + http://dl.acm.org/citation.cfm?id=2691137 + +* GNU Parallel was cited in: Distinguishing cause from effect using + observational data: methods and benchmarks + http://arxiv-web3.library.cornell.edu/pdf/1412.3773.pdf + +* GNU Parallel was cited in: Data Science at the Command Line + http://cdn.oreillystatic.com/oreilly/booksamplers/9781491947852_sampler.pdf + +* GNU Parallel was cited in: Resolution of Genetic Map Expansion + Caused by Excess Heterozygosity in Plant Recombinant Inbred + Populations http://www.g3journal.org/content/4/10/1963.full.pdf + +* GNU Parallel was cited in: Bayesian Inference of Protein Structure + from Chemical Shift Data https://peerj.com/preprints/692v1.pdf + +* GNU Parallel was cited in: Clonal interference and Mullerʼs ratchet + in spatial habitats http://iopscience.iop.org/1478-3975/11/5/056003 + +* GNU Parallel was cited in: Computação Verde na Camada de Aplicação + https://linux.ime.usp.br/~tpaiva/mac0499/files/monografia.pdf + +* GNU Parallel was cited in: Frameshift alignment: statistics and + post-genomic applications + http://bioinformatics.oxfordjournals.org/content/30/24/3575.full.pdf+html + +* GNU Parallel was cited in: Towards Recommender Engineering Tools and + Experiments for Identifying Recommender Differences + http://elehack.net/research/thesis/mde-thesis.pdf + +* GNU Parallel was cited in: Speaker Environment Classification Using + Rhythm Metrics in Levantine Arabic Dialect + http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6923918 + +* GNU Parallel was cited in: A Formal Proof Of The Kepler Conjecture + http://arxiv.org/pdf/1501.02155.pdf + +* GNU Parallel was cited in: Allocation Policy Analysis for Cache + Coherence Protocols for STT-MRAM-based caches + http://conservancy.umn.edu/bitstream/handle/11299/169362/Nandkar_umn_0130M_15551.pdf + +* GNU Parallel was cited in: Using Trusted Platform Module for + securing virtual environment access in Cloud + http://dar.aucegypt.edu:8080/bitstream/handle/10526/4237/Using%20Trusted%20Platform%20Module%20for%20Securing%20Virtual%20Environment%20Access%20in%20Cloud.pdf + +* GNU Parallel was cited in: Weakly Supervised Learning for + Compositional Sentiment Recognition + http://computerlinguist.org/static/downloads/ma-thesis/Master_Thesis-Michael_Haas-Weakly_Supervised_Learning_for_Compositional_Sentiment_Recognition.pdf + +* GNU Parallel was cited in: Agility and Performance in Elastic + Distributed Storage http://dl.acm.org/citation.cfm?id=2668129 + +* GNU Parallel was used (unfortunately without citation) in: Large + Scale Author Name Disambiguation in Digital Libraries + http://semanticommunity.info/@api/deki/files/31523/P227_3546.pdf + +* GNU Parallel is used in BEDOPS: + https://media.readthedocs.org/pdf/bedops/v2p5p0/bedops.pdf + +* Job ad asking for GNU Parallel skills: + http://www.aplitrak.com/?adid=dXMzMTYxMjQuMzg0MTkuMTU1MEBtYW5wb3dlcmZveG5hLmFwbGl0cmFrLmNvbQ#sthash.kYCIhhty.KcoT6HnJ.dpbs + +* GNU Parallel: Open Source For You (OSFY) magazine, October 2013 + edition + http://www.shakthimaan.com/posts/2014/11/27/gnu-parallel/news.html + +* Multithreaded Encryption and Compression + http://www.krazyworks.com/multithreaded-encryption-and-compression/ + +* GNU Parallel on OSX and Linux + https://darknightelf.wordpress.com/2015/01/01/gnu-parallel-on-osx/ + +* How to build gnu parallel from source on Ubuntu PC? + http://blog.ovidiuparvu.com/build-gnu-parallel-source-ubuntu-pc/ + +* GNU parallel for openaddr-process-one + https://nelsonslog.wordpress.com/2015/01/09/gnu-parallel-for-openaddr-process-one/ + +* From SRA Project to FastQ http://danielecook.com/sra-project-fastq/ + +* Software Development Tooling + http://www.computer.org/csdl/mags/so/2014/06/mso2014060021.pdf + +* コマンドを並列に実行するGNU parallelがとても便利 + http://bicycle1885.hatenablog.com/entry/2014/08/10/143612 + +* Bug fixes and man page updates. + + +20141122 + +* Remote systems can be divided into hostgroups (e.g. web and db) by + prepending '@groupname/' to the sshlogin. Multiple groups can be + given by separating groups with '+'. E.g. @web/www1 @web+db/www2 + @db/mariadb + +* Remote execution can be restricted to servers that are part of one + or more groups by '@groupname' as an sshlogin. Multiple groups can + be given by separating groups with '+'. E.g. -S @web or -S @db+web + +* With --hostgroup you can restrict arguments to certain hostgroups by + appending '@groupname' to the argument. Multiple groups can be + given by separating groups with '+'. E.g. my_web_arg@web + db-or-web-arg@db+web db-only-arg@db Thanks to Michel Courtine for + developing a prototype for this. + +* GNU Parallel was cited in: HTSeq-Hadoop: Extending HTSeq for + Massively Parallel Sequencing Data Analysis using Hadoop + http://essenceofescience.se/wp-content/uploads/2014/11/Siretskiy.pdf + +* GNU Parallel was cited in: SlideToolkit: An Assistive Toolset for + the Histological Quantification of Whole Slide Images + http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0110289 + +* GNU Parallel was cited in: Exploring a multiprocessor design space + to analyze the impact of using STT-RAM in the memory hierarchy + http://conservancy.umn.edu/bitstream/handle/11299/167286/Borse_umn_0130M_15431.pdf + +* Command-Line OCR with Tesseract on Mac OS X + https://ryanfb.github.io/etc/2014/11/13/command_line_ocr_on_mac_os_x.html + +* Bug fixes and man page updates. + + +20141022 + +* --env was changed to deal with Bash's new way of exporting a function. + +* GNU Parallel was cited in: Exclusion of cosmic rays in + protoplanetary disks. II. Chemical gradients and observational + signatures http://iopscience.iop.org/0004-637X/794/2/123/article + +* GNU Parallel was cited in: Application of Machine Learning to + Algorithm Selection for TSP + http://www.dbai.tuwien.ac.at/staff/musliu/art_ictai_cam.pdf + +* GNU Parallel was cited in: Performance Models for LTE-Advanced + Random Access + http://repository.asu.edu/attachments/137242/content/Tyagi_asu_0010E_14116.pdf + +* GNU Parallel was used (unfortunately without citation) in: De Novo + Insertions and Deletions of Predominantly Paternal Origin Are + Associated with Autism Spectrum Disorder + http://www.cell.com/cms/attachment/2019079667/2039310868/mmc1.pdf + +* GNU Parallel was determined 'popular' by Statistical Analysis of + Popular Open Source Software Projects and Their Communities + http://andiwre.itmaranatha.org/prosiding/ICITEE2014/PaperAndiWRE-ICITEE2014.pdf + +* GNU Parallel is demonstrated in: Data Science at the Command Line: + Facing the Future with Time-Tested Tools + +* GNU Parallel was covered in a talk at Sydney Perl Mongers group + http://www.openfusion.net/talks/pwp/#24 + +* GNU Parallel and how to get started with it + http://www.jduck.net/blog/2014/09/30/gnu-paralell/ + +* Behat/Selenium/Parallel + http://jaffamonkey.com/behat-selenium-parallel/ + +* Comparing Golang, Scala, Elixir and Ruby for ETL + http://www.dimroc.com/2014/09/29/etl-language-showdown/ + +* Assemble a list of which of these hosts are up or down + http://opsfun.wordpress.com/2014/03/31/gnu-parallel/ + +* Running commands on many nodes simultaneously + http://opsfun.wordpress.com/2014/03/31/19/ + +* Ubuntu 13.04でGNU ParallelをGNUモードで動かす + http://qiita.com/YusukeSuzuki@github/items/7b96b5876bf980f21e85 + +* Bug fixes and man page updates. + + +20140922 + +* If the file given as --sshloginfile is changed it will be re-read + when a job finishes though at most once per second. This makes it + possible to add and remove hosts while running. + +* Brutha uses GNU Parallel https://pypi.python.org/pypi/brutha/1.0.2 + +* OCRmyPDF uses GNU Parallel https://github.com/fritz-hh/OCRmyPDF/ + +* GNU Parallel was presented at Balti and Bioinformatics "On-Air" + http://youtu.be/UtXlr19xTh8?t=2h5m0s + +* Pleiades Plus uses GNU Parallel + https://github.com/ryanfb/pleiades-plus + +* Imagemagick and GNU Parallel + http://deepdish.io/2014/09/15/gnu-parallel/ + +* GNU Parallel (Sebuah Uji Coba) + http://pr4ka5a.wordpress.com/2014/09/04/gnu-parallel-sebuah-uji-coba/ + +* GNU Parallel: 并行执行Linux命令 + http://blog.csdn.net/xzz_hust/article/details/39183837 + + +20140822 + +* GNU Parallel now uses the same shell it was started from as the + command shell for local jobs. So if GNU Parallel is started from + tcsh it will use tcsh as its shell even if the login $SHELL is + different. For remote jobs the login $SHELL will be used. + +* The whole current environment in bash can be copied by using a shell + wrapper function (Search manual for env_parallel). + +* --plus adds the replacement strings {+/} {+.} {+..} {+...} {..} + {...} {/..} {/...}. The idea being that '+foo' matches the opposite + of 'foo' and {} = {+/}/{/} = {.}.{+.} = {+/}/{/.}.{+.} = {..}.{+..} + = {+/}/{/..}.{+..} = {...}.{+...} = {+/}/{/...}.{+...} + +* GNU Parallel now deals correctly with the combination + rsync-3.1.X-client and rsync-2.5.7-server + +* GNU Parallel was cited in: A Web Service for Scholarly Big Data + Information Extraction + http://patshih.ist.psu.edu/publications/Williams-CiteSeerExtractor-ICWS14.pdf + +* Comparison of the speed of different GNU Parallel versions: + http://lists.gnu.org/archive/html/parallel/2014-08/msg00030.html + +* GNU Parallel was covered in the webcast 2014-08-20: Data Science at + the Command Line http://www.oreilly.com/pub/e/3115 + +* Distributed processing with GNU parallel + http://kazjote.eu/2014/08/11/distributed-processing-with-gnu-parallel + +* A Peek into GNU Parallel + http://blog.dataweave.in/post/94238943763/a-peek-into-gnu-parallel + +* Сборка GNU parallel для CentOS/RHEL + http://www.stableit.ru/2014/07/gnu-parallel-centosrhel.html + +* Bug fixes and man page updates. + + +20140722 + +* {= perl expression =} can be used as replacement string. The + expression should modify $_. E.g. {= s/\.gz$// =} to remove .gz from + the string. This makes replacement strings extremely flexible. + +* Positional perl expressions (similar to {2}) are given as {=2 perl + expression=} where 2 is the position. + +* One small backwards incompatibility: {1}_{2} will replace {2} with + the empty string if there is only one argument. Previously {2} would + have been left untouched. + +* Replacement strings can be defined using --rpl. E.g. parallel --rpl + '{.gz} s/\.gz$//' echo {.gz} ::: *.gz + +* The parenthesis around {= perl expression =} can be changed with + --parens. + +* --tmux will direct the output to a tmux session instead of + files. Each running jobs will be in its own window. + +* --halt 10% will stop spawning new jobs if 10% failed so far. + +* GNU Parallel was cited in: bammds: A tool for assessing the ancestry + of low depth whole genome data using multidimensional scaling (MDS) + http://bioinformatics.oxfordjournals.org/content/early/2014/06/28/bioinformatics.btu410.abstract + +* GNU Parallel was cited in: Molecular ferroelectric contributions to + anomalous hysteresis in hybrid perovskite solar cells + http://people.bath.ac.uk/aw558/publications/2014/arxiv_hysteresis_14.pdf + +* GNU Parallel was cited in: Energy Sorghum-a genetic model for the + design of C4 grass bioenergy crops + http://jxb.oxfordjournals.org/content/early/2014/06/20/jxb.eru229.short + +* GNU Parallel was cited in: Web-scale Content Reuse Detection + www.isi.edu/~johnh/PAPERS/Ardi14a.pdf + +* Tell your friends to sign up for the Webcast at 2014-08-20 covering + GNU Parallel: Data Science at the Command Line + http://www.oreilly.com/pub/e/3115 + +* GNU Parallel all the things! + http://longwayaround.org.uk/notes/gnu-parallel-all-the-things/ + +* Shell command composition and dispatch + http://lukeluo.blogspot.dk/2014/07/linux-virtual-console6-shell-command.html + +* Parallelising plink (or anything else) the easy way + http://chrisladroue.com/2012/03/parallelising-plink-or-anything-else-the-easy-way/ + +* Easy and cheap cluster building on AWS + https://grapeot.me/easy-and-cheap-cluster-building-on-aws.html + +* Paralelizace běžných činností v konzoli pomocí GNU Parallel + http://www.abclinuxu.cz/clanky/paralelizace-beznych-cinnosti-v-konzoli-pomoci-gnu-parallel + +* [原] Ubuntu 下使用 parallel 命令的注意事项 + http://blog.ailms.me/2014/06/28/ubuntu-with-parallel.html + +* 简单的并行, 可使用GNU parallel + http://jerkwin.github.io/2014/06/10/GNU-parallel/ + +* Bug fixes and man page updates. + + +20140622 + +* --shebang and --shebang-wrap now works on FreeBSD. + +* --pipepart works with --header, --regexp, --cat and --fifo. + +* ./configure --disable-documentation will not build documentation. + +* {%} works as job slot. + +* GNU Parallel was cited in: Energy Efficient, High-speed + Communication in WSNs + https://gupea.ub.gu.se/bitstream/2077/35801/1/gupea_2077_35801_1.pdf + +* GNU Parallel was cited in: Ferroelectric contributions to anomalous + hysteresis in hybrid perovskite solar cells + http://arxiv.org/pdf/1405.5810.pdf + +* Processes Paralleling to Speed up Computing and Tasks Execution in + Linux + http://kukuruku.co/hub/nix/processes-paralleling-to-speed-up-computing-and-tasks-execution-in-linux + +* Moving / Copying lots of s3 files quickly using gnu parallel + http://blog.aclarke.eu/moving-copying-lots-of-s3-files-quickly-using-gnu-parallel/ + +* Speeding up grep log queries with GNU Parallel + http://www.tripwire.com/state-of-security/incident-detection/speeding-grep-queries-gnu-parallel/ + +* Ubuntu - Gnu parallel - It's awesome + http://kasunweranga.blogspot.dk/2014/06/ubuntu-gnu-parallel-its-awesome.html + +* Export quicklooks with vector overlay using TuiView + http://spectraldifferences.wordpress.com/2014/03/08/export-quicklooks-with-vector-overlay-using-tuiview/ + +* GNU Parallel指南 http://my.oschina.net/enyo/blog/271612 + +* GNU parallelで違和感 http://jarp.does.notwork.org/diary/201405c.html#201405301 + +* Bug fixes and man page updates. + + +20140522 + +* Use --semaphoretimeout to ignore the semaphore lock after a while. + +* {%} introduced as job slot replacement string. It has known bugs. + +* --slotreplace changes slot replacement string. + +* GNU Parallel officially in Solaris 11.2beta + https://blogs.oracle.com/alanc/entry/solaris_11_2_changes_to + +* GNU Parallel was cited in: A Comparison of Antenna Placement + Algorithms http://abhinavjauhri.com/publications/eap.pdf + +* Using GNU Parallel on a PBS cluster (nice use of --shebang-wrap) + https://docs.it4i.cz/anselm-cluster-documentation/resource-allocation-and-job-execution/capacity-computing + +* BioLite uses GNU Parallel: https://bitbucket.org/caseywdunn/biolite + +* Isitdown uses GNU Parallel: http://www.isi.edu/~calvin/isitdown.md + +* Convert FLAC to MP3 with GNU parallel + http://www.blogobramje.nl/posts/Convert_FLAC_to_MP3_with_GNU_parallel/ + +* JD Edwards Business Function Documentation + http://www.azertech.net/content/jd-edwards-business-function-documentation + +* Tools of the trade http://blog.eikeland.se/2014/05/01/tools-of-the-trade/ + +* How I start a bioinformatics project + http://nickloman.github.io/2014/05/14/how-i-start-a-bioinformatics-project/ + +* No:The-Me GNU Parallel http://adityalaghate.in/gnu-parallel.html + +* Bug fixes and man page updates. + + +20140422 + +* --pipepart is a highly efficient alternative to --pipe if the input + is a real file and not a pipe. + +* If using --cat or --fifo with --pipe the {} in the command will be + replaced with the name of a physical file and a fifo respectively + containing the block from --pipe. Useful for commands that cannot + read from standard input (stdin). + +* --controlmaster has gotten an overhaul and is no longer + experimental. + +* --env is now copied when determining CPUs on remote system. Useful + for copying $PATH if parallel is not in the normal path. + +* --results now chops the argument if the argument is longer than the + allowed path length. + +* Build now survives if pod2* are not installed. + +* The git repository now contains tags of releases. + +* GNU Parallel was cited in: Proactive System for Digital Forensic + Investigation + http://dspace.library.uvic.ca:8080/bitstream/handle/1828/5237/Alharbi_Soltan_PhD_2014.pdf + +* GNU Parallel was cited in: Beyond MAP estimation with the + track-oriented multiple hypothesis tracker + http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=6766651&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D6766651 + +* GNU Parallel was cited in: Prokka: rapid prokaryotic genome + annotation + http://bioinformatics.oxfordjournals.org/content/early/2014/03/18/bioinformatics.btu153.short + +* GNU Parallel was used (unfortunately with improper citation) in: + Perspectives in magnetic resonance: NMR in the post-FFT era + http://www.sciencedirect.com/science/article/pii/S1090780713003054 + +* GNU Parallel is used in https://github.com/cc2qe/speedseq + +* Batch XML validation at the command line. + http://horothesia.blogspot.dk/2014/04/batch-xml-validation-at-command-line.html + +* freebayes-parallel uses GNU Parallel + https://github.com/ekg/freebayes/commit/31ee997984cebe8a196381c3de57e618e34a2281 + +* Org-mode with Parallel Babel http://draketo.de/english/emacs/parallel-babel#sec-2 + +* Speeding Up Grep Log Queries with GNU Parallel + http://www.cybersecurity.io/speeding-grep-queries-gnu-parallel/ + +* How to run tbss_2_reg in parallel + http://tadpolebrainimaging.blogspot.dk/2014/03/how-to-run-tbss2reg-in-parallel.html + +* GNU parallel example: blastn https://asciinema.org/a/8775 + +* Iterative DNS Brute Forcing + http://www.room362.com/blog/2014/02/19/iterative-dns-brute-forcing/ + +* Ejecutando comandos en paralelo + http://jesusmercado.com/guias/ejecutando-comandos-en-paralelo/ + +* Ejecutando en paralelo en bash (ejemplo con rsync) + http://eithel-inside.blogspot.dk/2014/04/ejecutando-en-paralelo-en-bash-ejemplo.html + +* Bug fixes and man page updates. + + +20140322 + +* Offical package for Alpine Linux now exists: + http://alpinelinux.org/apk/main/x86/parallel + +* GNU Parallel was cited in: Estimating uncertainties in statistics + computed from direct numerical simulation + http://dx.doi.org/10.1063/1.4866813 + +* GNU Parallel was cited in: Vehicle routing problems with time + windows and multiple service workers: a systematic comparison + between ACO and GRASP + http://link.springer.com/article/10.1007/s10100-014-0341-z + +* GNU Parallel, quick and easy + http://www.reganmian.net/blog/2014/03/09/gnu-parallel-quick-and-easy/ + +* Using Multiple CPU Cores With Command Line Tools + http://prateekvjoshi.com/2014/03/07/using-multiple-cpu-cores-with-command-line-tools/ + +* Batch convert mp3 CBR to VBR + http://blogs.zercle.com/bouroo/2013/03/batch-convert-mp3-cbr-to-vbr/ + +* Running Behat in parallel with Selenium grid + http://zalas.eu/running-behat-in-parallel-with-selenium-grid/ + +* Git-Mirror per cronjob aktuell halten + https://www.schtobia.de/2013/git-mirror-per-cronjob-aktuell-halten/ + +* Пишем многопоточный скрипт на bash + http://dafter.ru/duf/howto/130.html + +* 如何利用多核CPU来加速你的Linux命令 + http://www.chinadmd.com/file/xpcr6wpctzwtuu3ivwiaatcs_1.html + +* Bug fixes and man page updates. + + +20140222 + +* --tollef has been retired. + +* --compress has be redesigned due to bugs. + +* Format of --eta and --joblog has changed slightly. + +* GNU Parallel was cited in: Speaker Verification and Keyword Spotting + Systems for Forensic Applications + http://lantana.tenet.res.in/website_files/thesis/Phd/srikanth.pdf + +* GNU Parallel was cited in: Scaleable Code Clone Detection + http://scg.unibe.ch/archive/phd/schwarz-phd.pdf + +* GNU Parallel was cited in: Clone Detection that scales + http://scg.unibe.ch/archive/masters/Vogt14a.pdf + +* GNU Parallel was cited in: Scalable Positional Analysis for Studying + Evolution of Nodes in Networks + http://arxiv-web3.library.cornell.edu/pdf/1402.3797 + +* GNU Parallel was cited in: Aggregate Characterization of User + Behavior in Twitter and Analysis of the Retweet Graph + http://arxiv.org/pdf/1402.2671v1 + +* GNU Parallel was used (unfortunately without citation) in: Causal + Network Models for Predicting Compound Targets and Driving Pathways + in Cancer + http://jbx.sagepub.com/content/early/2014/02/10/1087057114522690.full + +* GNU Parallel was used (unfortunately without citation) in: + Performance and Energy Efficiency of Common Compression / + Decompression Utilities + http://www.researchgate.net/publication/243962643_Performance_and_Energy_Efficiency_of_Common_CompressionDecompression_Utilities_An_Experimental_Study_in_Mobile_and_Workstation_Computer_Platforms/file/3deec51d1dbc0474f9.pdf + +* GNU Parallel was used (unfortunately without citation) in: SpringFS: + Bridging Agility and Performance in Elastic Distributed Storage + http://www.istc-cc.cmu.edu/publications/papers/2014/SpringFS-FAST14.pdf + +* GNU Parallel was recommended (without citation) in: Redesigning the + Specificity of Protein-DNA Interactions with Rosetta + http://link.springer.com/protocol/10.1007/978-1-62703-968-0_17 + +* GNU Parallel is co-distributed with RepeatExplorer + http://www.vcru.wisc.edu/simonlab/bioinformatics/programs/repeatexplorer/README.txt + +* Convert MP3 to a scrolling spectrum waterfall plot video + http://jdesbonnet.blogspot.dk/2014/02/convert-mp3-to-scrolling-spectrum.html + +* PHP wrapper class for the GNU Parallel tool + https://github.com/geopal-solutions/gnu-parallel-wrapper/tree/master + +* Exploratory Data Analysis http://www.slideshare.net/thinrhino/gnunify + +* Copias de archivos con rsync y parallel + http://linuxmanr4.com/2014/02/20/copias-de-archivos-con-rsync-y-parallel + +* Single-Thread-Programme auf Multicore-Rechnern parallelisieren + http://www.adlerweb.info/blog/2014/02/08/linux-single-thread-programme-auf-multicore-rechnern-parallelisieren + +* Распараллеливаем процессы для ускорения вычислений и выполнения + заданий в Linux http://savepearlharbor.com/?p=210480 + +* Bug fixes and man page updates. + + +20140122 + +* GNU Parallel was cited in: On the likelihood of multiple bit upsets + in logic circuits + http://arxiv-web3.library.cornell.edu/pdf/1401.1003 + +* HaploClique uses GNU Parallel + https://github.com/armintoepfer/haploclique + +* Scraping NSScreencast + https://blog.nicolai86.eu/posts/2014-01-12/scraping-nsscreencast/ + +* 30 Cool Open Source Software I Discovered in 2013 + http://www.cyberciti.biz/open-source/30-cool-best-open-source-softwares-of-2013/ + +* [Unix] 13. The power of doing things in Parallel + http://leetaey.tistory.com/384 + +* Parallel the execution of a job that read from stdin + http://www.linuxask.com/questions/parallel-the-execution-of-a-job-that-read-from-stdin + +* Mon Make à moi (6:38-11:50) + http://videos.rennes.inria.fr/ReNaBI-GO2013/indexPierreLindenbaum.html + +* Shell-Abarbeitung beschleunigen: Wie Sie mit parallelen Prozesse + effizienter in der Shell arbeiten + https://www.hosteurope.ch/blog/shell-abarbeitung-beschleunigen-wie-sie-mit-parallelen-prozesse-effizienter-in-der-shell-arbeiten/ + +* Summary of GNU Parallel tutorial + http://hacktracking.blogspot.dk/2014/01/gnu-parallel-tutorial.html + +* Bug fixes and man page updates. + + +20131222 + +* GNU Parallel now has a motto: For people who live life in the + parallel lane. + +* Detect if the buffer dir $TMPDIR runs out of space. This changes a + central piece of code, making this release alpha quality. + +* --keep-order --(n)onall will sort according to the sshlogin. + +* Detect the number of CPUs on DEC Tru64. + +* GNU sql: --list-tables for sqlite3. + +* GNU Parallel was cited in: Variational Message-Passing: Extension to + Continuous Variables and Applications in Multi-Target Tracking + http://www.ics.uci.edu/~ajfrank/pubs/thesis.pdf + +* GNU Parallel was cited in: Genome Assembly: Scaffolding Guided by + Related Genomes + https://www.duo.uio.no/handle/10852/37431 + +* GNU Parallel was cited in: Metagenomic analysis of Mariana Trench + sediment samples + http://repositorio.ul.pt/handle/10451/9436 + +* GNU Parallel was cited in: Diacritization, automatic segmentation + and labeling for Levantine Arabic speech + http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642556 + +* GNU Parallel was cited in: Investigation of emotion classification + using speech rhythm metrics + http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6642591 + +* GNU Parallel was cited in: A Rhythm-Based Analysis of Arabic Native + and Non-Native Speaking Styles + http://www.ijsps.com/uploadfile/2013/1128/20131128014413279.pdf + +* GNU Parallel was cited in: Evolutionary optimization of wetlands + design + http://dl.acm.org/citation.cfm?id=2480400 + +* GNU Parallel was cited (unfortunately with wrong citation) in: + RDBMS vs NoSQL: Performance and Scaling Comparison + http://www.epcc.ed.ac.uk/sites/default/files/Dissertations/2012-2013/RDBMS%20vs%20NoSQL%20-%20Performance%20and%20Scaling%20Comparison.pdf + +* GNU Parallel was used (without proper citation) in: Comprehensive + Analysis Pipeline for Discovery of Human Genetic Variation + http://www.google.com/patents/US20130311106 + +* Encrypt and decrypt in parallel with GPG + http://blog.tkassembled.com/412/encrypt-and-decrypt-in-parallel-with-gpg/ + +* Using GNU Parallel to create a SVM classifier + http://ivanyu.me/blog/2013/12/01/parallel/ + +* Parallel xz compression + http://anthon.home.xs4all.nl/rants/2013/parallel_xz/ + +* Got CPUs to burn? Put 'em to work with GNU parallel + http://baoilleach.blogspot.dk/2013/11/got-cpus-to-burn-put-em-to-work-with.html + +* Parallel rsync + http://pastebin.com/JmnB9ffq + +* Gnu Parallel for fun and profit + https://gist.github.com/celoyd/f7eb55ad69c9b33fd8c3 + +* Parallelization of Exploitation + http://rantsideasstuff.com/parallelization-of-exploitation/ + +* Running assemblies in parallel + https://khmer-protocols.readthedocs.org/en/v0.8.3/metagenomics/4-assemble.html + +* Procesando la contabilidad del PP + http://www.neorazorx.com/2013/07/procesando-la-contabilidad-del-pp.html + +* Mon make à moi (French) + http://www.slideshare.net/lindenb/mon-make-moi-tout-sauf-galaxy + +* Bug fixes and man page updates. + + +20131122 + +* A citation notice is printed on stderr only if stderr is a terminal, + the user has not specified --no-notice and the user has not run + --bibtex once. This makes the release alpha quality. + +* --compress will compress temporary files. If the output is big and + very compressible this will take up less disk space in $TMPDIR and + possibly be faster due to less disk I/O. + +* --compress-program comtrols which program to use for compressing + temporary files. + +* --bar show progress as a progress bar compatible with zenity. + +* --resume can now be used with --result: Jobs already run will be + skipped. + +* --transfer and --basefile support paths relative to the --workdir by + inserting /./ into the path. + +* GNU Parallel was cited in: fastphylo: Fast tools for phylogenetics + http://www.biomedcentral.com/1471-2105/14/334/abstract + +* Using GNU parallel + http://davetang.org/muse/2013/11/18/using-gnu-parallel/ + +* Techlux - GNU - Parallel (German) + https://techlux.de/blog/2013/11/07/gnu-parallel/ + +* awk, sed, bzip2, grep, wc на всех ядрах + http://vk.com/page-30666517_45528467 + +* 如何利用多核CPU來加速你的Linux命令 — awk, sed, bzip2, grep, wc等 + http://www.hksilicon.com/kb/articles/290543/CPULinuxawk-sed-bzip2-grep-wc + +* GNU Parallel (Japanese) + http://jarp.does.notwork.org/diary/201311b.html#20131117 + +* Bug fixes and man page updates. + + +20131022 + +* --transfer files with /./ in the path will copy the files relative + to the --workdir. + +* The maximal command length is now cached in a file halfing the + startup time. + +* GNU Parallel was cited in: Investigating speaker gender using rhythm + metrics in Arabic dialects + http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6602389 + +* GNU Parallel was cited in: Tiedon erist ̈minen ja visualisointi a + lastensuojelun asiakaskertomuksista + https://tampub.uta.fi/handle/10024/84978 + +* Some Additional Useful Bioinformatics Software + http://nix-bio.blogspot.dk/2013/10/additional-software-for-bioinformatics.html + +* GNU Parallel Example Screen Cast (bil to Geotiff conversion) + http://www.youtube.com/watch?v=PpF27eC7Mys + +* Using GNU Parallel to roll-your-own Map Reduce! + http://www.rankfocus.com/hello-world/ + +* Use multiple CPU Cores with your Linux commands + http://www.rankfocus.com/use-cpu-cores-linux-commands/ + +* Using GNU Parallel at HPC @ Uni.lu + https://hpc.uni.lu/users/use_cases/ + +* Scaling up with parallelization + https://www.msi.umn.edu/sites/default/files/AdvPython_1.pdf + +* How to teach yourself to be a technical tester + http://infiniteundo.com/post/62421363463/qa-toc + +* Faster Rasters For All + http://2013.foss4g.org/conf/programme/presentations/52/ + +* Optimizing translated file downloads + http://www.smartling.com/blog/2013/05/20/optimizing-translated-file-downloads/ + +* EMC NetWorker parallel saveset cloning with nsrclone and GNU parallel + http://www.beebotech.com.au/2013/10/emc-networker-parallel-saveset-cloning-with-nsrclone-and-gnu-parallel/ + +* Best Practices for Amazon EMR + http://media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf + +* Computing checksums for backup + https://identi.ca/evan/note/6yf1GzAARtyBhj__xzMvAg + +* Un exemplu de utilizare a programului GNU parallel + http://vundicind.blogspot.dk/2013/10/exemplu-utilizare-gnu-parallel.html + +* 平行化你的工作 + http://www.slideshare.net/drakeguan/part1-23705978 + +* なんか気持ちよかです Gnu Parallel + http://a3-lab.jpn.org/note/%E3%81%AA%E3%82%93%E3%81%8B%E6%B0%97%E6%8C%81%E3%81%A1%E3%82%88%E3%81%8B%E3%81%A7%E3%81%99-gnu-parallel + +* Bug fixes and man page updates. + + +20130922 + +* PDF-files of documentation is now included. + +* Cloning at warp speed 100 VMs in 1 minute using one command line + http://www.beebotech.com.au/tag/command-line/ + +* Calcul Quebec's introduction to GNU Parallel + https://wiki.calculquebec.ca/w/GNU_parallel + +* Brincando com o GNU parallel + http://blog.tadeucruz.com/2013/09/brincando-com-o-gnu-parallel/ + +* GNU Parallelで並列処理を行う + http://qiita.com/PENGUINANA_/items/af27a833e835fe17f09b + +* Bug fixes and man page updates. + + +20130822 + +* A tutorial showing much of GNU Parallel's functionality. Spend an + hour walking through the tutorial. Your commandline will love you + for it. man parallel_tutorial + +* --line-buffer will buffer output on line basis. --group keeps the + output together for a whole job. --ungroup allows output to mixup + with half a line coming from one job and half a line coming from + another job. --line-buffer fits between these two; it prints a full + line, but will allow for mixing lines of different jobs. + +* --record-env records all variables and functions set. Useful to + record the normal environment before using --env _. + +* --env _ exports all functions and variables to the remote server + except for the ones recorded. + +* New signing key. Due to recommendations from NIST + http://www.keylength.com/en/4/ the signing key was changed from + 1024D/ID:FFFFFFF1 to 9888R/ID:88888888. + +* Agalma: an automated phylogenomics workflow + http://arxiv.org/pdf/1307.6432 + +* Job ad asking for GNU Parallel expertise + http://seattle.craigslist.org/est/sof/4006079352.html + +* Transient Beowulf Clustering with GNU Parallel and SSHfs + http://www.reddit.com/r/linux/comments/1ka8mn/transient_beowulf_clustering_with_gnu_parallel/ + +* Aligning to unique regions + http://davetang.org/muse/2013/07/22/aligning-to-unique-regions/ + +* Top 10 scripting tricks for basic bioinformatics + http://students.washington.edu/bowmanjs/wordpress/?p=873 + +* Using GNU Parallel to speed up and simplify data analyzes + http://www.sergeymarkov.com/blog/2013/07/using-gnu-parallel-to-speed-up-and-simplify-data-analyzes/ + +* Compression of files in parallel using GNU parallel + http://codextechnicanum.blogspot.dk/2013/07/compression-of-files-in-parallel-using.html + +* Using GNU Parallel with Amazon + media.amazonwebservices.com/AWS_Amazon_EMR_Best_Practices.pdf + +* Some useful comments on GNU Parallel + https://news.ycombinator.com/item?id=6209767 + +* Using GNU Parallel to count reads mapping to genes for multiple BAMs + http://drduanehassane.com/blog/sequencing-resources + +* TimeMachineっぽいバックアップスクリプト + http://rio.tc/2013/07/timemachine-1.html + +* GNU ParallelでAndroid NDKの全バージョンを一括ダウンロード + http://qiita.com/mazgi/items/b10bf0ff3da2045d19ab + +* Bug fixes and man page updates. + + +20130722 + +* --round-robin with --pipe will write all blocks to already running + jobs. + +* --env can now transfer Bash function for remote execution. That is + pretty cool! + +* GNU Parallel was used (unfortunately with improper citation) in: + Understanding the Impact of E-Commerce Software on the Adoption of + Structured Data on the Web + http://link.springer.com/chapter/10.1007/978-3-642-38366-3_9#page-1 + +* GNU Parallel was used (unfortunately with improper citation) in: + CWI at TREC 2012, KBA track and Session Track + http://trec.nist.gov/pubs/trec21/papers/CWI.kba.session.final.pdf + +* Mitigation of Adverse Effects Caused by Shock Wave Boundary Layer + Interactions through Optimal Wall Shaping. + http://arc.aiaa.org/doi/abs/10.2514/6.2013-2653 + +* Using GNU parallel to convert images. + http://www.brunokim.com.br/blog/?p=18 + +* A quick way to parallelize. + http://timotheepoisot.fr/2013/07/08/parallel/ + +* GNU Parallel 20130522 ('Rana Plaza') 发布，并行作业执行. + http://www.open-open.com/news/view/371301 + +* Quite a few bug fixes and man page updates. + + +20130622 + +* --xapply now recycles arguments if an input source has more + arguments than others. + +* The sleep time between jobs is now both increased and decreased + exponentially. + +* 10 seconds installation check the signature using GnuPG if GnuPG is + installed. + +* Developer job asking for GNU Parallel expertise. + http://careers.stackoverflow.com/jobs/35562/developer-big-data-geo-and-web-climate-central + +* A small utility program to run youtube-dl in parallel. + https://github.com/dlh/youtube-dl-parallel + +* Parallelizing Freesurfer: + http://blog.cogneurostats.com/?p=148 + +* Bug fixes and man page updates. + + +20130522 + +* --ctrlc is now default if --pipe is not used; thus making it + possible to kill remotely started jobs simply by pressing Ctrl-C. + +* --timeout 200% now means kill jobs that take more than twice the + time of the median run time of a job. + +* Jobs are now distributed round robin when having mulitiple + --sshlogin instead of filling up one --sshlogin at a time. + +* niceload: darwin version of --io --mem --swap. Thanks to Anders F + Björklund. + +* Bug fixes and man page updates. + + +20130422 + +* 10 seconds installation: wget -O - pi.dk/3 | sh + +* HPUX CPU/core detection. Thanks to Javier Tarradas. + +* CPU detection for HURD, IRIX, SCO OpenServer and (old) HPUX. + +* --ctrlc will send SIGINT to tasks running on remote computers and + thus killing them. + +* --load now uses 'ps' to see immediately see the number of running + processes instead of 'uptime' thus making --load react much faster. + +* Testing on Centos 3.9 and FreeBSD 7 revealed a lot of compability + bugs. Some of these required quite extensive changes making this + release beta quality. + +* --retries works with --onall. + +* The new --load computation now works on FreeBSD 7. + +* --nice works under tcsh. + +* GNU Parallel is officially supported in NetBSD. + http://ftp.netbsd.org/pub/pkgsrc/current/pkgsrc/parallel/parallel/README.html + +* GNU Parallel is accepted for openSUSE. + http://software.opensuse.org/package/gnu_parallel + +* GNU Parallel can be installed under Microsoft Windows (CygWin). + http://blogs.msdn.com/b/hpctrekker/archive/2013/03/30/preparing-and-uploading-datasets-for-hdinsight.aspx + +* Excuses for not installing GNU Parallel. + http://oletange.blogspot.dk/2013/04/why-not-install-gnu-parallel.html + +* Job advert that requires GNU Parallel competence. + http://versium.com/about/careers/ + +* Parallelizing Batch Jobs for Fun and Profit. + http://mikeseidle.com/tech/programming/2013/03/parallelizing-batch-jobs + +* Processing Transcription Start Sites(TSS) for the entire Mouse genome. + http://qbrc.swmed.edu/2013/03/gnu-parallel-speeding-up-unix-commands-and-scripts/ + +* GNU parallel is used throughout Scrimer. + http://scrimer.readthedocs.org/en/latest/ + +* GNU Parallel helped making public documents searchable. + http://danpalmer.me/blog/articles/2013-04-06-unlocking-hillsborough.html + +* Identifying big movie files (German). + http://blackappsolutions.wordpress.com/2013/03/23/wenn-der-plattenplatz-knapp-wird-filme-identifizieren-die-viel-platz-belegen/ + +* Bug fixes and man page updates. + + +20130222 + +* --resume works with --pipe. + +* --resume-failed will go through --joblog, redo the failed jobs and + then continue like --resume. + +* Negative positional arguments count from the end: {-1} means the + last argument, {-2} the second to last. + +* NetBSD CPU detection. + +* --blocksize increases exponentially if it smaller than a full + record. + +* Processing n-line records (--pipe -L n) is now much faster. + +* --tollef is obsoleted after discussion on the mailing list. + +* GNU Parallel is the highest rated tool on: + http://www.biostars.org/show/tools/?sort=votes&since=all%20time + +* GNU Parallel was loved during FSFE's #ilovefs campaign. + http://fsfe.org/news/2013/news-20130212-01.en.html + +* Using GNU Parallel with s3cmd (Japanese). + http://blog.suz-lab.com/2013/02/s3cmd-gnu-paralells3.html + +* Intro to GNU Parallel (Chinese). + http://guiquanz.github.com/2013/02/12/gnu-parallel-intro/ + +* Bug fixes and man page updates. + + +20130122 + +* --sshdelay Delay starting next ssh by secs seconds. GNU parallel + will pause secs seconds after starting each ssh. secs can be less + than 1 seconds. + +* Official OpenBSD port: + http://ftp.openbsd.org/ports/sysutils/parallel/ + +* Official DragonFlyBSD package: + http://www.mirrorservice.org/sites/ftp.dragonflybsd.org/packages/amd64/DragonFly-3.0.0/stable/parallel/ + +* Post about niceload in Hungarian: + http://commandline.blog.hu/2013/01/02/niceload + +* 自炊スキャンデータをKobo Gloに最適化 + http://interstadial.wordpress.com/2013/01/20/ + +* GNU parallel+ssh で複数のリモートホストに複数のコマンドを実行させる + http://oshiire.to/archives/1686 + +* Bug fixes and man page updates. + + +20121222 + +* --shebang-wrap makes is possible to parallelize scripts by putting + parallel in the shebang line (the first #! line in scripts). + +* --delay puts in a delay after starting each job. Useful to avoid + raceconditions and thundering herd problems. + +* --results now uses / as separator instead of TAB and thus creates + subdirs. Thanks to Drew Frank. + +* parallel: OpenBSD CPU detection. Thanks to Michał Markowski. + +* niceload --sensor allows for negative numbers to signify a lower + number means the limit is lower. + +* niceload --prg suspend a named program that is already running. + +* niceload multiple --pid suspend process ids that are already running. + +* Convertir des images avec find et imagemagick + http://roger.b.over-blog.com/article-convertir-des-images-avec-find-et-imagemagick-113416637.html + +* Bug fixes and man page updates. + + +20121122 + +* niceload --sensor makes it possible to use a program to control if a + program should be suspended. + +* GNU Parallel was part of the justification for Nordic Free Software + Award 2012 + https://fsfe.org/news/2012/news-20121112-01.html + +* Dateien schneller packen und konvertieren mit GNU parallel + http://www.linux-community.de/Archiv/Tipp-der-Woche/Dateien-schneller-packen-und-konvertieren-mit-GNU-parallel + +* Processing images from Lunar Reconnaissance Orbiter Narrow Angle + Camera http://lunokhod.org/?p=774 + +* GNU Parallel is used in types2: Type and Hapax Accumulation Curves + http://www.cs.helsinki.fi/u/josuomel/types2/ + +* GNU Parallel used in: A Hybrid Factor Analysis and Probabilistic + PCA-based system for Dictionary Learning and Encoding for Robust + Speaker Recognition + http://www.superlectures.com/odyssey2012/lecture.php?id=8&lang=en + http://www.cse.iitm.ac.in/~mrsri/ppca.pdf + +* Mapreduce avec parallel, cat et une redirection + http://datacratic.com/site/blog/mapreduce-avec-parallel-cat-et-une-redirection + +* GNU Parallel for Large Batches of Small Jobs + https://support.scinet.utoronto.ca/wiki/images/7/7b/Tech-talk-gnu-parallel.pdf + +* GNU Parallel used in black belt tip (8:50-10:12) + https://aws.amazon.com/apac/awspodcast/episode20/ + +* Bug fixes and man page updates. + + +20121022 + +* --results structures output files so they can be imported using + Pandas (http://pandas.pydata.org/). Useful when doing simulations to + select output from some arguments. + +* Use --env to transfer environment variables through ssh to remote + machines. + +* GNU Parallel is accepted for Ubuntu Quantal. + http://packages.ubuntu.com/quantal/parallel + +* GNU Parallel was requested for OpenSUSE (go vote!) + https://features.opensuse.org/314461 + +* Kneth's Korner: Map/Reduce and GNU Parallel + http://kenneth.geisshirt.dk/2012/10/mapreduce-and-gnu-parallel.html + +* Blog post in Japanese by Siguniang. + https://siguniang.wordpress.com/2012/09/09/notes-on-gnu-parallel-the-command-line-power-tool/ + (Siguniang mentions the logo is called 'The Cafe Wall Illusion') + http://www.michaelbach.de/ot/ang_cafewall/index.html + +* GNU Parallel, where have you been all my life? + http://ssdigit.nothingisreal.com/2012/09/gnu-parallel-where-have-you-been-all-my.html + +* Reference-free ddRADseq analysis tools uses GNU Parallel. + https://github.com/brantp/rtd#readme + +* When bash just isn’t quick enough. + https://soimasysadmin.wordpress.com/2012/08/15/gnu-parallel-when-bash-just-isnt-quick-enough/ + +* Using GNU Parallel to Package Multiple Jobs in a Single PBS Job. + http://www.nas.nasa.gov/hecc/support/kb/Using-GNU-Parallel-to-Package-Multiple-Jobs-in-a-Single-PBS-Job_303.html + +* GNU Parallel Notes. + http://xed.ch/help/parallel.html + +* Bug fixes and man page updates. + + +20120822 + +* Due to a bugfix the main flow has changed. Making this release beta + quality. + +* Parallel Proxy Scraper & Checker Tool + https://www.youtube.com/watch?v=iXCeR_XsP6o + +* Bug fixes and man page updates. + + +20120722 + +* GNU Parallel was presented at Chiang Mai Bar Camp + http://barcampchiangmai.org/ + See write up here: + http://www.cnx-software.com/2012/07/02/use-gnu-parallel-to-speed-up-script-execution-on-multiple-cores-andor-machines/ + +* I don't always max out all my CPUs, but when I do, I do it with GNU + Parallel. + http://memegenerator.net/instance/22638454 + +* Bug fixes and man page updates. + + +20120622 + +* '-L n --pipe' will use records of n lines. This is useful when + processing data that have fixed records with a fixed number of + lines (e.g. fastq). + +* --filter-hosts will remove down hosts. For each remote host: check + that login through ssh works. If not: do not use this host. + Currently you can not put --filter-hosts in a profile, $PARALLEL, + /etc/parallel/config or similar. This is because GNU Parallel uses + GNU Parallel to compute this, so you will get an infinite loop. This + will likely be fixed in a later release. + +* --pipe now uses fork() instead of busy wait. The performance should + be better on computers with >10 cores while remaining the same on + computers with few cores. + +* GNU Parallel will be represented at Chiang Mai Bar Camp. + http://barcampchiangmai.org/ + +* Indexing Big Data on Amazon AWS: The Screencast + (Check out his T-shirt at 18:40-21:00). + http://www.opensourceconnections.com/2012/06/06/indexing-big-data-on-amazon-aws-screencast/ + +* biotoolbox uses GNU Parallel. + https://code.google.com/p/biotoolbox/wiki/Pod_novo_wrapper + +* Spiceweasel uses GNU Parallel. + https://github.com/mattray/spiceweasel + +* GNU Parallel part of The Administrators Challenge. + http://challenge.twistedrack.com/questions/qs3.php + +* Finding Oldest Firefox Code using GNU Parallel. + http://gregoryszorc.com/blog/2012/06/18/finding-oldest-firefox-code/ + +* Bug fixes (quite a few for remote job running) and man page updates. + + +20120522 + +* Timings in --joblog now with milliseconds. + +* Thesis using GNU Parallel (correctly cited; hooray!). + http://scholarworks.sjsu.edu/etd_projects/222/ + +* Package for AIX. + http://www.perzl.org/aix/index.php?n=Main.Parallel + +* Prokka uses GNU Parallel. + http://bioinformatics.net.au/prokka-manual.html + +* GNU Parallel was presented at MUUG. + http://muug.mb.ca/blog/meetings/2012/05/09/may-8th-2012-rtfm-gnu-parallel1/ + +* Blog post: Manipulating many or large files with GNU parallel. + http://compbiously.blogspot.com/2012/05/manipulating-many-or-large-files-with.html + +* Blog post: Running commands in parallel using bash. + http://blog.michaelboman.org/2012/04/running-commands-in-parallel-using-bash.html + +* Blog post in Hungarian. + http://commandline.blog.hu/2012/05/03/gnu_parallel + +* Popularity of GNU Parallel in Debian explodes. + http://qa.debian.org/popcon-graph.php?packages=parallel + +* Bug fixes and man page updates. + + +20120422 + +* A race condition bug caused restructuring of a central piece of the + code. Thus this release of GNU Parallel should be considered beta + quality. + +* sql --dbsize will now list sizes of all databases if given no + database. + +* GNU Parallel is now in Debian Unstable. + apt-get install parallel + +* Article: Computational and experimental analyses of + retrotransposon-associated minisatellite DNAs in the soybean genome. + http://www.biomedcentral.com/content/supplementary/1471-2105-13-s2-s13-s1.pdf + +* Blog post: GNU parallel - the best thing since sliced bread. + https://arrayal.wordpress.com/2012/03/27/gnu-parallel-the-best-thing-since-sliced-bread/ + +* Blog post: GNU Parallel makes everything faster. + http://compbiously.blogspot.com/2012/03/gnu-parallel-makes-everything-faster.html + +* Blog post (German): Howto: GNU parallel. + http://d24m.de/2012/04/05/howto-gnu-parallel/ + +* Blog post: Running in Parallel + http://interactivity.ifactory.com/2012/04/running-in-parallel/ + +* 20000 watched the first intro video. + http://pi.dk/1 + +* The first 5 have received their GNU Parallel merchandise + https://www.gnu.org/software/parallel/merchandise.html + +* Bug fixes and man page updates. + + +20120322 + +* Parallel Process Database Dumps. + http://blog.mattoates.co.uk/2012/02/parallel-process-database-dumps.html + +* Using GNU Parallel to process images from Mars. + http://lunokhod.org/?p=468 + +* Using GNU Parallel with bzgrep. + http://filip.rembialkowski.net/did-you-know-gnu-parallel/ + +* Bug fixes and man page updates. + + +20120222 + +* --workdir . will use the current working dir. If the current working + dir is beneath your home dir, the value . is treated as the relative + path to your home dir. This means that if your home dir is different + on remote computers (e.g. if your login is different) the relative + path will still be relative to your home dir. + +* A texinfo file is now generated from the POD file using pod2texi. + +* The bioinformatics article "Fast large-scale clustering of protein + structures using Gauss integrals" mentions GNU Parallel. They forgot + to add the reference. Please remember --bibtex if you use GNU + Parallel in an article. + http://bioinformatics.oxfordjournals.org/content/28/4/510.short + +* The first supporter received his merchandise. Did you order yours? + https://www.gnu.org/software/parallel/merchandise.html + +* How to use GNU Parallel with samtools. + http://zvfak.blogspot.com/2012/02/samtools-in-parallel.html + +* How to use GNU Parallel for vacuuming PostgreSQL tables. + http://blog.timmattison.com/archives/2012/01/24/mini-hack-parallel-vacuuming-in-postgresql/ + +* Converting e-books with Calibre and GNU Parallel. + http://www.linkhal.de/blog/2012/01/converting-massive-e-book-collections-with-calibre-and-gnu-parrallel/ + +* Using GNU Parallel for tailing logfiles from multiple servers. + http://silviud.blogspot.com/2012/02/shell-parallel-processing.html + +* Bug fixes and man page updates. + + +20120122 + +* --header : uses the first input line as column names and you can + then use {colname} as a replacement string in the command. This also + works with multiple :::'s. + +* --header <regexp> matches a header as a regular expression and + repeats the header for each block with --pipe. + +* --resume resumes from the last unfinished job. Useful if you stop + GNU Parallel and restart it later with the same arguments. + +* niceload now propagates exit status correctly. + +* Show your support for GNU Parallel. For a limited time you can get a + GNU Parallel T-shirt+mug+pen+100 postcards at 20 EUR. See + https://www.gnu.org/software/parallel/merchandise.html + +* Options -g -B -T -U -W -Y are retired as warned 6 months ago. + +* GNU Parallel referenced in article on Holographic Grid Cloud. Thanks + to Stefano Gallozzi. http://arxiv.org/pdf/1112.6128 + +* Article in IEEE Software on GNU Parallel. Thanks to Diomidis + Spinellis. http://www.spinellis.gr/blog/20110911/ + +* An article on Narwhal which uses GNU Parallel. They forgot to add + the reference. Please remember --bibtex if you use GNU Parallel in + an article. + http://bioinformatics.oxfordjournals.org/content/early/2011/11/08/bioinformatics.btr613.full.pdf + +* Blog post on using GNU Parallel to speed up BLAST queries: + http://blog.mckuhn.de/2012/01/embarrassingly-parallel-blast-search.html + +* Video showing Wake-on-LAN with GNU Parallel. + https://www.youtube.com/watch?v=0mB-yIyKFLQ + +* Using GNU Parallel with Solr. + http://sujitpal.blogspot.com/2011/12/solr-report-generation-with-python.html + +* First job ad including GNU Parallel: + http://seeker.dice.com/jobsearch/servlet/JobSearch?op=101&dockey=xml/7/6/76f858de083a094f74b1a5d3ba53ffc5@endecaindex + +* Bug fixes and man page updates. + + +20111222 + +* --timeout will now kill grandchildren. + +* Interview in Hacker Public Radio. + http://hackerpublicradio.org/eps.php?id=0860 + +* Blog post in Chinese. + http://blog.sina.com.cn/s/blog_3f7652740100y0ju.html + +* Bug fixes and man page updates. + + +20111122 + +* GNU Parallel package for Fedora. + https://admin.fedoraproject.org/pkgdb/acls/name/parallel + +* Using GNU Parallel with Mozilla cross referencing. + https://blog.mozilla.com/it/2011/11/15/mxr-improvements/ + +* Neat flash presentation of GNU Parallel. + http://prezi.com/0nq74b2elgtx/about-gnu-parallel/ + +* How to create tar files of dirs in parallel. + https://joneslee85.wordpress.com/2011/11/22/shell-tips-how-to-recursively-archive-many-folders/ + +* Article in Admin Network&Security by Ben Martin. + http://www.admin-magazine.com/HPC/Articles/GNU-Parallel + +* Blog post in Polish. + http://blog.tiger.com.pl/2011/01/05/gnu-parallel/ + +* Blog post on using GNU Parallel of Mac OS X. + http://www.0xcb0.com/2011/10/19/running-parallel-bash-tasks-on-os-x/ + +* Blog post in English by researcher. + http://zandyware.wordpress.com/2011/10/15/gnu-parallell-make-best-use-of-your-multicore-computer/ + +* Blog entry in Chinese. + http://blog.csdn.net/tossense/article/details/6889026 + +* Blog entry in Japanese on managing many servers. + http://hiroakis.com/blog/2011/11/13/gnu-parallel/ + +* GNU Parallel is now part of ppbs. + http://physiology.med.cornell.edu/faculty/mason/lab/ppbs/introduction/introduction.html + +* How to use GNU Parallel with MCX. + http://mcx.sourceforge.net/cgi-bin/index.cgi?MMC/Doc/MMCCluster + +* Bug fixes and man page updates. + + +20111022 + +* --tag prepends lines with the argument(s). If used with --(n)onall + the line will be prepended with the sshlogin instead. + +* --shellquote does not run the command but quotes it using \'s. + Useful for making quoted composed commands. + +* --profile can now be repeated merging multiple profiles. + +* --bibtex now gives the BibTeX entry. + Thanks to Aleksandr Levchuk for testing. + +* Makefile for simple .deb package. + cd packager/debian; make + +* sql: --list-databases lists the databases. + +* GNU Parallel officially in Fedora 16 + http://www.spinics.net/lists/fedora-package-announce/msg67130.html + +* Blog post on recompression FLAC audio. + http://blog.oxplot.com/2011/08/reflac-flac-cleanser.html + +* The most complex use of ::: I have seen so far. + http://agentzlerich.blogspot.com/2011/09/following-up-on-previous-failures-ive.html + +* Example of using GNU Parallel with sudo. + http://loopkid.net/articles/2011/10/07/recursive-chmod-and-chown-on-files + +* Use wget and gnu parallel to download mp3s at rocket speed. + http://sdbrain.posterous.com/use-wget-and-gnu-parallel-to-download-mp3s-at + +* First CV referring to GNU Parallel. + http://www.peopleperhour.com/freelancers/stephen_/internet_researcher_and_protocol_develop/140602 + +* Cartwright labs usage of GNU Parallel. + http://cartwrightlab.wikispaces.com/The+Most+Bang+for+Your+Buck + +* Bug fixes and man page updates. + + +20110822 + +* --timeout implemented so that slow commands can be killed + +* CPU detection improved for Mac OSX. Thanks to Wayne E. Seguin. + +* Example of a parallel webcrawler in the man page. + +* Backup up PostgreSQL with GNU Parallel. Thanks to Stephane Wirtel. + http://wirtel.be/2011/07/15/rsync_parallel/ + +* Blog post in Japanese. + http://dminor11th.blogspot.com/2011/08/gnu-parallel.html + +* Blog post about optimizing JPEGs. Thanks to Thomas Jost. + http://schnouki.net/2011/07/22/optimizing-jpeg-pictures/ + +* Bug fixes and man page updates. + + +20110722 + +* niceload: --hard will suspend a program if a limit is reached - as + opposed to just slowing the program down. + +* niceload: --soft will slow the program down - as opposed to + suspending the program completely. + +* niceload: --run-io will slow down a program if disk io goes above a + certain limit. + +* niceload: --run-load will slow down a program if loadaverage goes + above a certain limit. + +* niceload: --run-mem will slow down a program if free memory goes + below a certain limit. + +* niceload: --run-noswap will slow down a program if the computer is + swapping. + +* niceload: --start-io, --start-load, --start-mem, --start-noswap will + defer starting a program until the system is below the limit. + +* --io, --load, --mem, and --noswap sets both --run-* and --start-*. + +* niceload got a major rewrite and is now object oriented. + +* GNU Parallel was presented at Nordic Perl Workshop 2011. + http://conferences.yapceurope.org/npw2011/talk/3416 + +* Blog post about zcat and GNU Parallel. Thanks to Dr. John. + http://drjohnstechtalk.com/blog/2011/06/gnu-parallel-really-helps-with-zcat/ + +* 2 blog posts in Japanese. Thanks to Negima. + http://d.hatena.ne.jp/negima1976/20110607/1307412660 + http://d.hatena.ne.jp/negima1976/20110628/1309252494 + +* Blog post for bioinformatics. Thanks to Chris Miller. + http://chrisamiller.com/science/2010/05/26/use-parallel-for-easy-multi-processor-execution/ + +* Bug fixes and man page updates. + + +20110622 + +* --onall will run all the jobs on all the computers. This is useful + for systemadinistrators having multiple servers. + +* --nonall runs like --onall but reads no arguments from stdin + (standard input), so is possible to do: + parallel --nonall -S computer1,computer2 uptime + +* Context replace now works with multiple input sources: + parallel -X echo {1}-{2} ::: 1 2 3 ::: a b c + +* --noswap do not start a job on a server that is swapping. + +* Article: Parallel processing without Hadoop! + http://www.solutionhacker.com/parallel-processing-without-hadoop/ + +* Article in Linux Magazine (Spanish). Thanks to Ben Martin. + http://www.linux-magazine.es/issue/67/ + +* First blog post in Korean. Thanks to 민병국. + http://blog.daum.net/_blog/BlogTypeView.do?blogid=02RQ3&articleno=13380895&admin=# + +* Blog post in Japanese. Thanks to Naoya Nakazawa. + http://www.sssg.org/blogs/naoya/archives/2003 + +* Blog post in English. Thanks to Dagon. + http://hekate.homeip.net/2011/05/29/ + +* Bug fixes and man page updates. + + +20110522 + +* Multiple ::: can be put on the command line and will be treated + similar to contents from multiple -a's. + +* ::: and :::: can now be mixed on the command line. Use {1} .. {n} to + refer to inputs from the different input sources. + +* --xapply is now needed to get xapply's behaviour of reading one line + from each of the input sources. + +* Multiple input sources will cause all combinations of arguments from + the sources to be generated. E.g. 'parallel echo {1}+{2} ::: 1 2 ::: + a b c' will print 1+a 1+b 1+c 2+a 2+b 2+c. This can often replace + nested loops. + +* Implemented {//} for the input line with the basename removed (dirname). + +* New video showing the new ::: and :::: input sources. + http://tinyogg.com/watch/iOdhU/ http://www.youtube.com/watch?v=fOX1EyHkQwc + +* GNU Parallel now has a logo. + http://www.gnu.org/software/parallel/logo.png + +* Article about GNU SQL in USENIX Magazine ;login: (print) + http://www.usenix.org/publications/login/2011-04/ + +* Using GNU Parallel with EC2. Thanks to Kevin Wu. + http://blog.kevinformatics.com/post/4970574713/interested-in-your-experience-using-gnu-parallel-in + +* Review with idea for {..} and {...} in Japanese. Thanks to ichii386. + http://d.hatena.ne.jp/ichii386/20110426 + +* Upgrade GNU Parallel using Macports. Thanks to Phil Hollenback. + http://www.hollenback.net/index.php/MacportsParallel + +* Robert from Echo One discusses using processes instead of threads: + http://rrees.wordpress.com/2011/04/25/many-cores-many-threads/ + +* How to run GNU Parallel on a SLURM cluster. Thanks to Kevin Stock. + http://www.kevinstock.org/2011/04/using-the-ri-cluster/ + +* Short article about using GNU Parallel with lame: + http://loopkid.net/articles/2011/04/30/accelerate-lame-mp3-conversion + +* Using GNU Parallel to run tail -f in Japanese. Thanks to Clouder. + http://blog.clouder.jp/archives/001140.html + +* BBC Research & Development uses GNU Parallel: + http://www.bbc.co.uk/blogs/researchanddevelopment/2010/11/prototyping-weeknotes-41-26112.shtml + +* Short article about using GNU Parallel on RHEL. Thanks to Rishi Deshpande. + http://nuclear-imaging.info/site_content/2011/05/11/gnu-parallel/ + +* Using GNU Parallel for FLAC->MP3 conversion. Thanks to Derek Marcotte. + http://derek.chezmarcotte.ca/?p=286 + +* Bug fixes and man page updates. + + +20110422 + +* {#} now works as an alias for $PARALLEL_PID. + +* --eta now estimates way more accurately. + +* CPU detection code for AIX thanks to Christian Netrwal. + +* --joblog contains exitcode. + +* Thanks to Ævar Arnfjörð Bjarmason for reading my code. + +* GNU Parallel was presented at: + - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm + - OSAA.dk, Aarhus, 2011-04-12 + +* Blog entry in Japanese. Thanks to Riywo. + http://blog.riywo.com/2011/04/19/022802 + +* Example of how to use GNU Parallel on PBS clusters. Thanks to Andrew + J Dolgert: http://web0.tc.cornell.edu/wiki/index.php?title=Gnu_Parallel + +* First example of using GNU Parallel in Hebrew. Thanks to omry. + http://nd.gd/jk + +* Intro video got past 10000 hits. + http://www.youtube.com/watch?v=OpaiGYxkSuQ + +* Bug fixes and man page updates. + + +20110322 + +* --tollef to be switch compatible with Tollef's parallel. This will + cause -l to mean --load, and the argument separator will be -- + instead of ::: + +* --gnu will force GNU Parallel to behave like GNU Parallel even if + --tollef is set. + +* Site wide config file: /etc/parallel/config + + This should solve the issue with some packagers renaming GNU + Parallel to gparallel to avoid the naming conflict. + + By putting --tollef in the site wide config file you can deinstall + Tollef's parallel and install GNU Parallel instead without any + change for users or scripts. This is useful for packagers that + currently rename GNU Parallel or simply do not distribute GNU + Parallel because the command name conflicts with Tollef's parallel. + +* -L 0 -n 0, and -N 0 implemented. They will read one argument, + but insert 0 arguments on the command line. Useful if you just want + to run the same command with the same arguments a number of times. + +* GNU Parallel is now in Fink. Thanks to Jesse Alama. + http://pdb.finkproject.org/pdb/package.php/parallel + +* Opscode Cookbook for Chef. Thanks to Joshua Timberman. + https://github.com/opscode/cookbooks/tree/master/gnu_parallel + +* Man page examples translated into Japanese. Thanks to Koshigoe. + http://w.koshigoe.jp/study/?%5Bsystem%5D+GNU+parallel+%BB%C8%CD%D1%CE%E3#l13 + +* GNU Parallel will be presented at: + - LUGA, Augsburg, 2011-03-26, http://www.luga.de/Aktionen/LIT-2011/Programm + - OSAA.dk, Aarhus, 2011-04-12 + +* Video of presentation from FSCONS 2010-11-07. The presenter was + _really_ hoarse that day (Something to do with loads of alcohol the + night before). http://vimeo.com/20838834 + +* Review with examples in German. Thanks to M. Nieberg. + http://kenntwas.de/2011/linux/gnu-parallel/ + +* A review of the --pipe option in German. Thanks to Mathias Huber. + http://www.linux-magazin.de/NEWS/GNU-Parallel-20110205-stueckelt-Daten + +* A small example of grepping maillogs. Thanks to François Maillet. + http://www.francoismaillet.com/blog/?p=399 + +* Using GNU Parallel instead of xargs. Thanks to James Cuff. + http://blog.jcuff.net/2011/02/on-train-ride-in.html + +* Bug fixes and man page updates. + + +20110205 + +* --pipe splits piped data into blocks. Each block is piped to a + program for processing. The piping and the programs will be run in + parallel. Useful if the data you want to process is data for a + program and not arguments. + +* --blocksize sets the blocksize in bytes for --pipe. The blocksize is + approximate. It can deviate as much as the size of one record. + Default is 1M. + +* --recstart sets the string matching the start of a + record. Default is "". + +* --recend sets the string matching the end of a + record. Default is '\n'. To specify none use --recend "". + + If both --recstart and --recend are set, the end of a record must be + followed immediately by a start of a record. This is useful if + either recend or recstart can occur in the middle of a record. + +* --remove-rec-sep removes the string matched by --recstart and + --recend. + +* --regexp will make GNU Parallel treat --recstart and --recend as + regular expressions. + +* --output-as-files will put the output of the programs into files and + instead of giving the output GNU Parallel will output the name of + these files. + +* -N if used with --pipe sets the number of records to read. + +* New video showing --pipe at + http://www.youtube.com/watch?v=1ntxT-47VPA + +* GNU Parallel was presented at FOSDEM. + +* Article in USENIX Magazine ;login: (print) + http://www.usenix.org/publications/login/2011-02/ + +* GNU Parallel is now on ohloh.net. Thanks to Wim Muskee. + https://www.ohloh.net/p/gnu-parallel + +* Advanced recursive example. Thanks to Ruarí Ødegaard. + http://my.opera.com/ruario/blog/2011/01/24/editing-debian-packages-more-fun-with-gnu + +* Small example on using GNU Parallel through 0install (German). + http://forum.ubuntuusers.de/topic/gnu-parallel-mit-zero-install-kurzinfo-kein-wi/ + +* Bug fixes and man page updates. + + +20110122 + +* --joblog makes a simple log of completed jobs. + +* -X now spreads arguments between job slots when reaching last + argument. Use -j1 to avoid this. + +* People on the email list have voted -j+0 to be the new default + instead of -j9. + +* First review in Polish. Thanks to Patryk Krawaczyński. + http://nfsec.pl/root/2458 + +* Review in Spanish (in print). + https://www.linux-magazine.es/issue/67/moreinfo.html + +* Review in English. Thanks to Brian Gough. + http://blogs.fsfe.org/bjg/2011/01/gnu-parallel-a-map-operator-for-the-command-line/ + +* Review in French. Thanks to Denis Dordoigne. + http://linuxfr.org/2010/12/29/27715.html + +* Review in Spanish. + http://gufete.net/index.php?entry=entry110116-200022 + +* Article with advanced recursive example. Thanks to Ruarí Ødegaard + http://my.opera.com/ruario/blog/2011/01/18/fun-with-gnu-parallel + +* Use case for memcache. + http://www.dctrwatson.com/2010/12/how-to-dump-memcache-keyvalue-pairs-fast/ + +* Bug fixes and man page updates. + + +20101222 + +* GNU niceload is now part of GNU Parallel. GNU niceload slows down a + program if the load average is above a certain limit. + +* Implemented --tmpdir to buffer standard output and standard error in + a different place. + +* Implemented --load to wait until the load is below a limit before + starting another job on that computer. + +* Implemented --nice set the niceness of jobs running both locally and + remotely. + +* Implemented --dry-run to print the job without running it. + +* Implemented --tty as the old default of assigning a tty to the first + job causes problems. + +* Review with focus on clusters. Thanks to Taylor Gillespie + http://www.unixpronews.com/unixpronews-49-20101019GNUParallelSpeedUpProcessingWithMulticoresClusters.html + +* Review with focus on protein similarity. + http://kevinformatics.tumblr.com/post/2142473893/cluster-like-computing-using-gnu-parallel + +* Review in Spanish. + http://gr3p.com/2010/12/gnu-parallel-acelera-tus-scripts-en-linux + +* Quite a few bug fixes and man page updates. + + +20101202 + +* Implemented {/} for the input line with the path removed (basename). + +* Implemented {/.} for the input line with extension and path removed + (basename). + +* Output from --progress is now sent to standard error instead of + standard output. + +* --eta was broken and counted down from 0. Now fixed. + +* Standard output and standard error are flushed after every job so if + standard output does not end with a newline it will still be grouped + with the rest of standard output. + +* --command, -c, --file, and -f are now removed as options. They were + never used in practice. + +* GetOptionsFromArray rewritten to work with old Perl libraries. + +* The file COPYING now contains the GNU General Public License 3 + +* Major rewrite to make the code more object oriented and easier to + maintain in the future. + + +20101113 + +* Using -j myfile the number of jobs can be changed while GNU Parallel + is running simply by changing the content of myfile. + +* Implemented --profile to use different .parallel/config for + different situations. + +* Ugly newlines in $PARALLEL and .parallel/config are no longer + needed. Instead you have to use \ in front of special shell + characters. + +* --workdir puts the files transferred to remote machines in a + specified directory. + +* $PARALLEL_PID is set to the process id of GNU Parallel. + +* $PARALLEL_SEQ is set to the sequence number of the job. + +* -v now only shows the command to run. Use -v -v to show the + ssh/rsync wrapping. + +* Slow spawning error is now only a warning. + +* If stdin is a tty and input is read from stdin you now get a + warning. + +* GNU sql: \n and \x0a in arguments is replaced with newline. + +* Patch for Debian package and spelling mistakes. Thanks to Rogério + Brito <rbrito at ime dot usp dot br> + +* Mac OS X Homebrew package. Thanks to Jonathan Palardy <jonathan dot + palardy at gmail dot com> + +* FreeBSD port. Thanks to Chris Howey <howeyc at gmail dot com> + +* Pardus package. Thanks to Fethican Coşkuner + <fethicanc at gmail dot com> + +* First review in Chinese. Thanks to 曾義峰: + http://antbsd.twbbs.org/~ant/wordpress/?p=2876 + +* First review in print: + http://www.linux-magazine.com/Issues/2010 Nov 2010 + +* First review in Spanish: + http://www.muylinux.com/2010/10/18/gnu-parallel-computacion-paralela-a-golpe-de-comando + +* First review in Dutch thanks to Koen Vervloesem <koen at vervloesem + dot eu>: + http://techworld.nl/technologie/33493/gebruik-al-je-processorkernen-met-gnu-parallel.html + +* Blog review thanks to R. Tyler Croy <tyler at monkeypox dot org>: + http://unethicalblogger.com/posts/2010/11/gnuparallel_changed_my_life + +* 5000 views of the intro video: + http://www.youtube.com/watch?v=OpaiGYxkSuQ + +* As usual a bunch of bugfixes and more usage examples in the man + page. + +* GNU Parallel was presented at FSCONS 2010-11-07: + http://www.fscons.org/fs/gnu-parallel Hopefully the + video will be online soon. + + +20100922 + +* See GNU Parallel live at FSCONS 2010-11-07: + http://www.fscons.org/fs/gnu-parallel + +* Untested Debian and xUbuntu packages available through OpenSUSE + build service: + https://build.opensuse.org/package/show?package=parallel&project=home%3Atange + +* Using --retries a job will be retried on another computer if it + fails. This is useful if some jobs fail for no apparent reason (such + as network failure). + +* BSD xargs -o (open /dev/tty) is now default for the job running in + foreground. Useful for interactive commands like: + ls | parallel -Xuj1 vi + +* GNU sql now supports SQLite. + +* Renamed .dburl.aliases to .sql/aliases and /etc/sql/aliases. + +* GNU sql now support --list-tables + +* Alias for DBURL can contain '?query' part with %-quoting. + + +20100906 + +* Using --shebang GNU Parallel can be used as the parser for a script. + E.g: #!/usr/bin/parallel --shebang traceroute (followed by lines of + hosts) + +* First community generated bugfixes + +* Alt Linux package of GNU Parallel. Thanks to Michael Shigorin <mike + at altlinux dot org> + +* Sunfreeware package of GNU Parallel. Thanks to Steven M. Christensen + <sunfreeware at gmail.com> + +* Untested CentOS, Fedora, Mandriva, RedHat, and SUSE packages + available through OpenSUSE build service: + https://build.opensuse.org/package/show?package=parallel&project=home%3Atange + +* Review of GNU Parallel. Thanks to Andrew McFague amcfague at wgen dot net + http://www.andrew-mcfague.com/linux/utilities-linux/ + commands-every-serious-nix-user-should-know/#parallel + +* First 1000 views of the intro video + +* sql - a small script to access sql bases from the command line which + is a handy companion to parallel --colsep + + +20100822 + +* Counting semaphore functionality: start a job in the background. If + N jobs are already running, wait for one to complete. Examples: + sem 'sleep 2; echo foo'; sem 'sleep 1; echo bar'; sem --wait + sem -j2 'sleep 2; echo foo'; sem -j2 'sleep 1; echo bar'; sem --wait + +* With --colsep a table can be used as input. Example: + cat tab_sep_table | parallel --colsep '\t' echo col1 {1} col2 {2} + +* --trim can remove white space around arguments. + +* --sshloginfile '..' means use ~/.parallel/sshloginfile + +* Zero install package. Thanks to Tim Cuthbertson <tim3d dot junk at + gmail dot com> + +* OpenSUSE package. Thanks to Markus Ammer <mkmm at gmx-topmail dot + de> + +* NixOS package. Thanks to Ludovic Courtès <ludo at gnu dot org> + +* Web review http://oentend.blogspot.com/2010/08/gnu-parallel.html + Thanks to Pavel Nuzhdin <pnzhdin at gmail dot com> + +* Web review http://psung.blogspot.com/2010/08/gnu-parallel.html + Thanks to Phil Sung <psung at alum dot mit dot edu> + + +20100722 + +* Arguments can now be given on the command line. Example: + parallel bzip2 ::: *.txt + +* xapply like functionality. Example: + parallel diff {1} {2} :::: filelist1 filelist2 + parallel diff {1} {2} ">"{1.}-{2.}.diff :::: filelist1 filelist2 + +* Arch Linux package. Thanks to Peter Simons <simons at cryp dot to> + +* Mandriva package. Thanks to Sandro Cazzaniga <kharec at mandriva dot + org> + +* -L -l -n -s now implies -X unless -m is set + + +20100620 + +* New video showing the new options. + http://www.youtube.com/watch?v=OpaiGYxkSuQ or at + http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/ + +* 100% options complete with xargs. All options for xargs can now be + used in GNU Parallel - even the more exotic. + +* --basefile for transferring basedata. When running jobs on remote + computers --basefile will transfer files before the first jobs is + run. It can be used to transfer data that remains the same for each + job such as scripts or lookup tables. + +* --progress shows progress. To see how many jobs is running on each + server use --progress. It can be turned on even after GNU Parallel + is started. + +* --eta shows estimated time left in seconds. + +* --halt-on-error stops if an error occurs. GNU Parallel will default + to run all jobs - even if some of them fail. With --halt-on-error + GNU Parallel can ignore errors, wait for the currently running jobs + to finish, or stop immediately when an error occurs. + + +20100601 + +* GNU Parallel now has support for running jobs on remote machines + +* Intro video http://www.youtube.com/watch?v=LlXDtd_pRaY + http://openvideo.dailymotion.com/video/xdmqwz_gnu-parallel-script-processing-and_tech + + +20100424 + +* GNU Parallel is now official GNU software |