Operating system installation guide/manual

At the reference base os is Ubuntu 14.10.

After the operating system is installed, do an upgrade right away:

sudo apt-get update && sudo apt-get dist-upgrade && sudo apt-get autoremove && sudo apt-get clean

Then always install (and never forget):

sudo apt-get install \
             git \
             mercurial \
             ssh \
             curl \
             ncurses-term \
             language-pack-en language-pack-sv

Find more ppas here.

When developing and/or deploying apps with lot's of different languages, versions and so on it is important to be able to control these environments tightly to make them as replicable as possible. I try to always manage an environment per project set up with different levels of isolation depending on the project needs. Also I try to always install at a user level so that operating system upgrades and so on won't interfere with the projects. An added bonus of installing to ~ is that the risk of messing up the OS by installing broken or semi broken packages further reduced.

Here follows a set of instruction of doing installations of the development chains I mainly use…

I synchronize all my ~ on different systems using git. This is how to fetch and install the repository.

Emacs is my main text/programming editor. My ~/.emacs.d/ configuration requires emacs 24.3 to function properly.

Install build dependencies:

# the following dependencies or similar are required to build
sudo apt-get install \
             libgtk-3-dev \
             libgif-dev \
             libxpm-dev \
             texinfo \
             libtiff5-dev \
             libxaw7-dev \
             librsvg2-dev \
             libmagickwand-dev \
             libgpm-dev \
             libgnutls-dev \
             libotf-dev \
             libm17n-dev \
             libacl1-dev

build emacs using the script in emacs.d

cd ~/.emacs.d
./installDeps emacs

I use the super awsome xmonad window manager.

sudo usermod -a -G sudo a00001
sudo usermod -a -G adm a00001
sudo usermod -a -G docker a00001

sudo dpkg-reconfigure lightdm

On all systems I usually disable password authentication for at least apt package upgrades. Launch sudoers configuration editing with sudo visudo and add the following to the bottom of the file:

# Allow passwordless apt updates and upgrades for admin users
%sudo,%admin ALL=(ALL)NOPASSWD:/usr/bin/apt-get update
%sudo,%admin ALL=(ALL)NOPASSWD:/usr/bin/apt-get upgrade
%sudo,%admin ALL=(ALL)NOPASSWD:/usr/bin/apt-get dist-upgrade
%sudo,%admin ALL=(ALL)NOPASSWD:/usr/bin/apt-get clean

Also, on desktop systems I usually allow rebooting and shutting down the system without a password

# Allow passwordless shutdown and reboot
%sudo,%admin ALL=(ALL)NOPASSWD:/sbin/shutdown now -h
%sudo,%admin ALL=(ALL)NOPASSWD:/sbin/reboot
%sudo,%admin ALL=(ALL)NOPASSWD:/usr/sbin/pm-suspend
%sudo,%admin ALL=(ALL)NOPASSWD:/usr/sbin/pm-hibernate

Might need this on a mac

%sudo,%admin ALL=(ALL)NOPASSWD:/usr/local/bin/acdcontrol /dev/usb/hiddev*

By default 5% of a filesystem will be flagged as reserved for root user. For modern high-capacity disks, this is much higher than necessary - particularly if the partition is not being used for system files. It is generally safe to reduce the percentage of reserved blocks to free up disk space when the partition is either large or not being used for system files Use the tune2fs utility to do this. The command below would set the percentage of reserved blocks on the partition /dev/sdXY to 0.2%:

sudo tune2fs -m 0.2 /dev/sdXY

# Install vice
sudo apt-get install vice

# Create temporary directory
cd `mktemp -d`

# Download CXXX roms and expand archive
wget ftp://ftp.zimmers.net/pub/cbm/crossplatform/emulators/VICE/old/vice-1.5-roms.tar.gz
tar -xf vice-1.5-roms.tar.gz

# Copy roms to correct location
cd vice-1.5-roms/data
sudo chown -R root:root .
sudo chmod -R 775 .
sudo rsync -r . /usr/lib/vice/

More or less copied from http://solderintheveins.co.uk/2011/03/ubuntu-sftp-only-account-how-to/

Using google public dns as an example here:

The structure of /opt/etherpad-lite is something like this:

.
|-- etherpad-lite
|   |-- available_plugins
|   |-- bin
|   |-- doc
|   |-- node_modules
|   |-- out
|   |-- src
|   |-- static
|   |-- tools
|   |-- var
|   |-- APIKEY.txt
|   |-- CHANGELOG.md
|   |-- CONTRIBUTING.md
|   |-- LICENSE
|   |-- Makefile
|   |-- README.md
|   |-- README.plugins
|   |-- settings.json
|   |-- settings.json.template
|   `-- start.bat
|-- node -> node-v0.8.14-linux-x86
`-- node-v0.8.14-linux-x86
    |-- bin
    |-- include
    |-- lib
    |-- share
    |-- ChangeLog
    |-- LICENSE
    `-- README.md

Create a system user for etherpad-lite

adduser --system --home /opt/etherpad-lite --group etherpad-lite

Create a filed name /etc/init/etherpad-lite.conf and fill it with the following contents

description "etherpad-lite"

start on started networking
stop on runlevel [!2345]

env NODEHOME=/opt/etherpad-lite/node
env EPHOME=/opt/etherpad-lite/etherpad-lite
env EPLOGS=/var/log/etherpad-lite
env EPUSER=etherpad-lite

respawn

# pre-start script
#     chdir $EPHOME
#     mkdir $EPLOGS                              ||true
#     chown $EPUSER:admin $EPLOGS                ||true
#     chmod 0755 $EPLOGS                         ||true
#     chown -R $EPUSER:admin $EPHOME/var         ||true
#     $EPHOME/bin/installDeps.sh >> $EPLOGS/error.log || { stop; exit 1; }
# end script

script
  cd $EPHOME/
  exec su -s /bin/sh -c 'exec "$0" "$@"' $EPUSER -- $NODEHOME/bin/node src/node/server.js \
                        >> $EPLOGS/access.log \
                        2>> $EPLOGS/error.log
end script

This hid-apple driver has options for this.

• 0 = Fn key disabled
• 1 = Fn key pressed by default
• 2 = Fn key released by default

From /drivers/hid/hid-apple.c line 42:

Apply directly

echo 2 > /sys/module/hid_apple/parameters/fnmode

Making the modification persistent

Open or create the hid_apple configuration file

sudo emacs /etc/modprobe.d/hid_apple.conf

Add this line

options hid_apple fnmode=2

Save file, apply changes and reboot

sudo update-initramfs -u

Just comment out everything in file://sudo:root@localhost:/lib/udev/rules.d/85-regulatory.rules

Manpage for crda

example syslog

wpa_supplicant[1108]: eth1: CTRL-EVENT-DISCONNECTED bssid=00:00:00:00:00:00 reason=0
kernel: [  162.659662] cfg80211: Calling CRDA to update world regulatory domain
NetworkManager[959]: <info> (eth1): supplicant interface state: completed -> disconnected
kernel: [  162.664195] cfg80211: World regulatory domain updated:
kernel: [  162.664200] cfg80211:   (start_freq - end_freq @ bandwidth), (max_antenna_gain, max_eirp)
kernel: [  162.664202] cfg80211:   (2402000 KHz - 2472000 KHz @ 40000 KHz), (300 mBi, 2000 mBm)
kernel: [  162.664203] cfg80211:   (2457000 KHz - 2482000 KHz @ 40000 KHz), (300 mBi, 2000 mBm)
kernel: [  162.664205] cfg80211:   (2474000 KHz - 2494000 KHz @ 20000 KHz), (300 mBi, 2000 mBm)
kernel: [  162.664206] cfg80211:   (5170000 KHz - 5250000 KHz @ 40000 KHz), (300 mBi, 2000 mBm)
kernel: [  162.664207] cfg80211:   (5735000 KHz - 5835000 KHz @ 40000 KHz), (300 mBi, 2000 mBm)
NetworkManager[959]: <info> (eth1): supplicant interface state: disconnected -> scanning
wpa_supplicant[1108]: eth1: Trying to associate with 00:00:00:00:00:00 (SSID='data' freq=2452 MHz)
NetworkManager[959]: <info> (eth1): supplicant interface state: scanning -> associating
wpa_supplicant[1108]: eth1: Associated with 00:00:00:00:00:00

sudo apt-get install samba

brew update
brew uninstall automake autoconf libtool pkg-config mu
brew install automake autoconf libtool pkg-config
EMACS=/Applications/Emacs.app/Contents/MacOS/Emacs brew install mu --with-emacs --HEAD
brew install offlineimap

Copy the certificate into osx (apple stores theme in their keyring which python does not use).

On a ubuntu box or similar:

scp /etc/ssl/certs/ca-certificates.crt remoteOsXhost:

on the osx box:

sudo mkdir -p /etc/ssl/certs/
sudo mv ~/ca-certificates.crt /etc/ssl/certs/
sudo chmod 775 /etc/ssl/certs/ca-certificates.crt

# try it
offineimap --dry-run

• pomme turns off the display when the charger is disconnected, uninstalling pomme makes this go away

Somehow docker got backgraded to 0.7 on one out of two machines upgraded.

reinstall docker

sudo apt-get remove lxc-docker
sudo apt-get install linux-image-extra-`uname -r`
curl -sSL https://get.docker.com/ | sh

Needed to uninstall redis-tool before redis stable ppa can be installed

sudo apt-get remove redis-server redis-tools

The Additional package repositories section of this manual is updated to reflect 14.10 changes.

Rvm seems to be incompatible with current 14.04 bash so let's delete rvm:

rm -rf ~/.rvm

install ruby 2.0 from apt instead (for now)

sudo apt-get install ruby2.1 ruby2.1-doc ruby2.1-dev

Reinstalled chrome to make it to readd its apt repository.

• http://www.held.org.il/blog/2011/05/the-myterious-case-of-broken-ssh-client-connection-reset-by-peer/
• https://bugs.launchpad.net/ubuntu/+source/openssh/+bug/708493
• http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=612607
• http://serverfault.com/questions/265244/ssh-client-problem-connection-reset-by-peer

Edit $HOME.ssh/config and add this in the Host * stanza or for the host you have problems connecting to:

(TODO :unverified:)

Ciphers aes128-ctr,aes192-ctr,aes256-ctr,aes128-cbc,3des-cbc
MACs hmac-md5,hmac-sha1,hmac-ripemd160

or maybe, if nothing else works:

Ciphers 3des-cbc

First find out which kernel you should NOT delete:

uname -r

3.8.0-35-generic

List all installed kernels

dpkg --list | grep linux-image

rc  linux-image-3.2.0-32-generic       3.2.0-32.51                       Linux kernel image for version 3.2.0 on 64 bit x86 SMP
ii  linux-image-3.8.0-30-generic       3.8.0-30.44~precise1              Linux kernel image for version 3.8.0 on 64 bit x86 SMP
ii  linux-image-3.8.0-34-generic       3.8.0-34.49~precise1              Linux kernel image for version 3.8.0 on 64 bit x86 SMP
ii  linux-image-3.8.0-35-generic       3.8.0-35.52~precise1              Linux kernel image for version 3.8.0 on 64 bit x86 SMP
ii  linux-image-3.8.0-36-generic       3.8.0-36.52~precise1              Linux kernel image for version 3.8.0 on 64 bit x86 SMP
ii  linux-image-3.8.0-37-generic       3.8.0-37.53~precise1              Linux kernel image for version 3.8.0 on 64 bit x86 SMP
iU  linux-image-generic-lts-raring     3.8.0.38.38                       Generic Linux kernel image

Delete the ones that will not be useful after an upgrate (keep the current one!)

sudo dpkg --purge linux-image-3.8.0-{30,34,36,37}

Then try to continue apt

sudo apt-get -f install

If that fails you probably have to install the kernel image that apt lists as an uninstalled dependency.

sudo apt-get install -f  linux-image-3.8.0-38-generic

Regenerate the grub boot menu here, just to feel safer.

sudo update-grub2

now apt should be able to continue

sudo apt-get -f install
sudo apt-get update
sudo apt-get upgrade

curl -L https://github.com/docker/machine/releases/download/v0.2.0/docker-machine_darwin-amd64 > /usr/local/bin/docker-machine
curl -L https://get.docker.com/builds/Darwin/x86_64/docker-latest > /usr/local/bin/docker
chmod +x /usr/local/bin/docker
chmod +x /usr/local/bin/docker-machine
docker-machine  create \
                -d vmwarefusion \
                --vmwarefusion-memory-size "2048"  \
                --vmwarefusion-boot2docker-url "https://github.com/boot2docker/boot2docker/releases/download/v1.6.2/boot2docker.iso" \
                docker
eval "$(docker-machine env docker)"

sudo easy_install pip
sudo pip install virtualenvwrapper

ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

most stuff that should be installed by cask/brew

The prerequisite is to have at least xcode/osx command line tools installed.

basic stuff:

brew install bash bash-completion git mercurial ispell 
brew install go nodejs 
brew install flac imagemagick 
brew install mosh htop-osx

extended stuff:

brew install kdiff3
brew tap benswift/extempore
brew install extempore

cask and casks:

brew install caskroom/cask/brew-cask

brew cask install \
          calibre gpgtools transmission \
          emacs intel-power-gadget steam \
          vlc firefox iterm2 xquartz google-chrome \
          karabiner cyberduck keka dropbox

brew cask install \
          xquartz google-chrome karabiner \
          cyberduck keka dropbox

#+begin_example. vagrant plugin install vagrant-vmware-fusion vagrant plugin install vagrant-vmware-fusion

#+end_example

remove unnamed images (not very safe, "grep none" could match something to be kept)

docker images --no-trunc | grep none | awk '{print $3}' | xargs -r docker rmi

Remove Docker containers with Exit status

docker ps -a --no-trunc | grep 'Exit' | awk '{print $1}' | xargs -r docker rm