Skip to content
Snippets Groups Projects

Compare revisions

Changes are shown as if the source revision was being merged into the target revision. Learn more about comparing revisions.

Source

Select target project
No results found
Select Git revision
  • main
  • master
2 results

Target

Select target project
  • can/unix-command-line
  • gdurif/unix-command-line_dev
2 results
Select Git revision
  • main
  • master
  • quarto-refactor
3 results
Show changes
Commits on Source (33)
Expand all Hide whitespace changes
Inline Side-by-side
Showing
with 1087 additions and 512 deletions
.gitignore
View file @ e03db036
*.html
.DS_Store
.Rproj.user
/.quarto/
/_book/
*_cache/
.gitlab-ci.yml
View file @ e03db036
# This file is a template, and might need editing before it works on your project.
# Full project: https://gitlab.com/pages/plain-html
pages:
stage: deploy
image: carinerey/r_for_beginners
image: rocker/tidyverse
script:
- mkdir -p public/
- cp -R img public/
- make
- apt update && apt install -y libxt6
- quarto -v
- |
quarto render
mkdir public
cp -r _book/* public/
interruptible: true
artifacts:
paths:
- public
......
10_network_and_ssh.Rmd
View file @ e03db036
---
title: Text manipulation
title: SSH
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
## Ssh
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
Objective: Learn basics of ssh connection in GNU/Linux
......@@ -39,11 +22,11 @@ In the previous section, we have seen how to run scripts and complex commands on
Most of the content from this session are from [wikipedia.org](https://wikipedia.org)
### Network
## Network
First before talking about how to communicate over a network, we need to define what is a network in computational science. We can distinguish between two types of network, **circuit switching** networks and **packet switching** networks.
#### circuit switching
### circuit switching
Circuit switching is the historical telephonic network architecture. When device A wants to communicate with device B, it has to establish a connection over the network. In a circuit switching network, the connections between a chain of nodes (hopefully the shortest chain) are established and fixed. Device A connects to the closest node and ask connection to Device B, this node will do the same thing to the closest node to Device B, so on and so forth until the connection reach Device B.
......@@ -51,7 +34,7 @@ If you try to call someone, who is already in a phone conversation, the line wil
![http://www.tcpipguide.com/free/diagrams/funcircuitswitching.png](./img/funcircuitswitching.png)
#### packet switching
### packet switching
Packet switching is a method of grouping data over the network into packets. Each packet has a header and a payload. The header data can be read by each node to direct the packet to its destination. The header data also inform the Host 2 of the packets order. The payload contains the data that we want to transmit over the network. In packet switching, the network bandwidth is not pre-allocated like in circuit switching. Each packet is called a datagram.
......@@ -61,7 +44,7 @@ Packet switching is a method of grouping data over the network into packets. Eac
In a packet switching network when you send a flux of data (video, sound, etc.), you have the illusion of continuity like for process switching handled by the scheduler.
### **Internet Protocol** (IP)
## **Internet Protocol** (IP)
> The **Internet Protocol** (**IP**) is the principal [communications protocol](https://en.wikipedia.org/wiki/Communications_protocol) in the [Internet protocol suite](https://en.wikipedia.org/wiki/Internet_protocol_suite) for relaying [datagrams](https://en.wikipedia.org/wiki/Datagram) across network boundaries. Its [routing](https://en.wikipedia.org/wiki/Routing) function enables [internetworking](https://en.wikipedia.org/wiki/Internetworking), and essentially establishes the [Internet](https://en.wikipedia.org/wiki/Internet).
......@@ -69,7 +52,7 @@ IP has the task of delivering [packets](https://en.wikipedia.org/wiki/Packet_(in
The first major version of IP, [Internet Protocol Version 4](https://en.wikipedia.org/wiki/IPv4) (IPv4), is the dominant protocol of the Internet. Its successor is [Internet Protocol Version 6](https://en.wikipedia.org/wiki/IPv6) (IPv6), which has been in increasing [deployment](https://en.wikipedia.org/wiki/IPv6_deployment) on the public Internet since c. 2006.
#### IPv4
### IPv4
An **IPv4** is composed of 4 digits ranging from 0 to 255 separated by `.` , which gives an address space of 4294967296 (2^32) addresses. Some combinations of **IPv4** are restricted:
......@@ -92,32 +75,37 @@ An **IPv4** is composed of 4 digits ranging from 0 to 255 separated by `.` , whi
| 240.0.0.0/4 | 240.0.0.0–255.255.255.254 | 268435455 | Internet | Reserved for future use.[[15\]](https://en.wikipedia.org/wiki/IPv4#cite_note-rfc3232-15) (Former Class E network). |
| 255.255.255.255/32 | 255.255.255.255 | 1 | Subnet | Reserved for the "limited [broadcast](https://en.wikipedia.org/wiki/Broadcast_address)" destination address.[[6\]](https://en.wikipedia.org/wiki/IPv4#cite_note-rfc6890-6)[[16\]](https://en.wikipedia.org/wiki/IPv4#cite_note-rfc919-16) |
#### IPv6
### IPv6
An **IPv6** is composed of 8 groups of 4 digits long number separated by `:`.
The numbers are in hexadecimal format (number of base 16, randing from 0 to 9 and A to F).
An **IPv6** is composed of 8 groups of 4 digits long number separated by `:`. The numbers are in hexadecimal format (number of base 16, randing from 0 to 9 and A to F). Compared to **IPv4**, **IPv6** allows for 2^128 = 340,282,366,920,938,463,463,374,607,431,768,211,456 addresses (approximately 3.4×10^38). For example, an IP address is: *2001:0db8:0000:0000:0000:ff00:0042:8329*
Compared to **IPv4**, **IPv6** allows for 2^128 = 340,282,366,920,938,463,463,374,607,431,768,211,456 addresses (approximately 3.4×10^38).
For example, an IP address is: **2001:0db8:0000:0000:0000:ff00:0042:8329**
To display your VM IP addresses you can use the following command: `ip address show`
Local **IPv6** addresses start with **fe80::**
#### **Domain Name System** (**DNS**)
### **Domain Name System** (**DNS**)
Instead of using IP addresses in your everyday life, you often use the domain name. The DNS is composed of many DNS servers that are hierarchically organized and decentralized. By querying the DNS with a particular domain name, the correct name server will return the corresponding IP address. For most network tools, you can use domain names (URL) or IP addresses.
![dns resolver](./img/dns_resolver.svg)
#### Transmission Control Protocol (**TCP**)
### Transmission Control Protocol (**TCP**)
The **Transmission Control Protocol** (**TCP**) is one of the main [protocols](https://en.wikipedia.org/wiki/Communications_protocol) of the [Internet protocol suite](https://en.wikipedia.org/wiki/Internet_protocol_suite). TCP provide, reliable, ordered, and error-checked delivery of a stream of data between applications running on hosts communincating over an IP network.
The **Transmission Control Protocol** (**TCP**) is one of the main [protocols](https://en.wikipedia.org/wiki/Communications_protocol) of the [Internet protocol suite](https://en.wikipedia.org/wiki/Internet_protocol_suite). TCP provide, reliable, ordered, and error-checked delivery of a stream of data between applications running on hosts communicating over an IP network.
- data arrives in-order
- data has minimal error (i.e., correctness)
- duplicate data is discarded
- lost or discarded packets are resent
- includes traffic congestion control
- Heavtweight (no ordering of messages, no tracking connections, etc. It is a very simple transport layer designed on top of IP)
- Heavyweight (loots of checks)
#### **User Datagram Protocol** (**UDP**)
### **User Datagram Protocol** (**UDP**)
UDP uses a simple [connectionless communication](https://en.wikipedia.org/wiki/Connectionless_communication) model with a minimum of protocol mechanisms.
......@@ -127,11 +115,11 @@ UDP uses a simple [connectionless communication](https://en.wikipedia.org/wiki/C
- Multicast (a single datagram packet can be automatically routed without duplication to a group of subscribers)
- Lightweight (no ordering of messages, no tracking connections, etc. It is a very simple transport layer designed on top of IP)
#### Port
### Port
Higher, communication protocols like TCP and UDP, also define **port**. A **port** is a communication endpoint. When software wants to communicate overt TCP or UDP it will do so using a specific **port**. Each system has **port** numbers ranging from 0 to 65535. **Port** numbered from 0 through 1023 are system **ports** used by well-known processes (you need specific rights to use them).
Higher, communication protocols like TCP and UDP, also define **port**. A **port** is a communication endpoint. When software wants to communicate overt TCP or UDP it will do so using a specific **port**. Each system has **port** numbers ranging from **0** to **65535**. **Port** numbered from **0** through **1023** are system **ports** used by well-known processes (you need specific rights to use them).
Here are a list of notable port numbers:
Here is a list of notable port numbers:
| Number | Assignment |
| ------ | ------------------------------------------------------------ |
......@@ -139,7 +127,7 @@ Here are a list of notable port numbers:
| 21 | [File Transfer Protocol](https://en.wikipedia.org/wiki/File_Transfer_Protocol) (FTP) Command Control |
| 22 | [Secure Shell](https://en.wikipedia.org/wiki/Secure_Shell) (SSH) Secure Login |
| 23 | [Telnet](https://en.wikipedia.org/wiki/Telnet) remote login service, unencrypted text messages |
| 25 | [Simple Mail Transfer Protocol](https://en.wikipedia.org/wiki/Simple_Mail_Transfer_Protocol) (SMTP) E-mail routing |
| 25 | [Simple Mail Transfer Protocol](https://en.wikipedia.org/wiki/Simple_Mail_Transfer_Protocol) (SMTP) e-mail routing |
| 53 | [Domain Name System](https://en.wikipedia.org/wiki/Domain_Name_System) (DNS) service |
| 67, 68 | [Dynamic Host Configuration Protocol](https://en.wikipedia.org/wiki/Dynamic_Host_Configuration_Protocol) (DHCP) |
| 80 | [Hypertext Transfer Protocol](https://en.wikipedia.org/wiki/Hypertext_Transfer_Protocol) (HTTP) used in the [World Wide Web](https://en.wikipedia.org/wiki/World_Wide_Web) |
......@@ -153,13 +141,13 @@ Here are a list of notable port numbers:
Nowadays, **ports** provide multiplexing, which means that multiple service or communication session can use the same **port** number.
### SSH
## SSH
There are numerous other protocols ([RTP](https://en.wikipedia.org/wiki/Real-time_Transport_Protocol) for example). But most of them run over the TCP and UDP protocols. **SSH** or **Secure Shell** is one of them. SSH is a [cryptographic](https://en.wikipedia.org/wiki/Cryptography) [network protocol](https://en.wikipedia.org/wiki/Network_protocol) for operating network services securely over an unsecured network.
There are numerous other protocols ([RTP](https://en.wikipedia.org/wiki/Real-time_Transport_Protocol) for example). But most of them run over the **TCP** and **UDP** protocols. **SSH** or **Secure Shell** is one of them. **SSH** is a [cryptographic](https://en.wikipedia.org/wiki/Cryptography) [network protocol](https://en.wikipedia.org/wiki/Network_protocol) for operating network services securely over an unsecured network.
SSH use a client-server architecture, you use an SSH client to connect to an SSH server. By default most Linux distribution don’t comes with an SSH server installed. For the IFB, SSH connection is the default way to connect to your VMs, so you should have an SSH sever up and running.
**SSH** use a client-server architecture, you use an **SSH client** to connect to an **SSH server**. By default most Linux distribution don’t come with an **SSH server** installed. For the IFB, **SSH** connection is the default way to connect to your VMs, so you should have an **SSH** sever running.
Find the name of the SSH server process
Find the name of the **SSH** server process
<details><summary>Solution</summary>
<p>
......@@ -169,27 +157,27 @@ ps -el | grep "ssh"
</p>
</details>
SSH uses [Public-key cryptography (or asymmetric cryptography](https://en.wikipedia.org/wiki/Public-key_cryptography)), to secure it’s communications.
SSH uses [Public-key cryptography (or asymmetric cryptography](https://en.wikipedia.org/wiki/Public-key_cryptography)), to secure its communications.
#### Public-key cryptography
### Public-key cryptography
[Public-key cryptography (or asymmetric cryptography](https://en.wikipedia.org/wiki/Public-key_cryptography)), is a cryptographic system which uses pairs of [keys](https://en.wikipedia.org/wiki/Cryptographic_key): *public keys* (which may be known to others), and *private keys* (which may never be known by any except the owner).
A cryptographic algorithm is used to generate a pair of *public* and *private* keys from a large random number. Then, the 3 following scheme can be used to secure communication:
#### Communicate with the server
### Communicate with the server
The server sent a public key to the client on the first connection.
![public_key_encryption](./img/public_key_encryption.png)
#### Share a secret
### Share a secret
Can be used to share public keys (see [Diffie-Hellman)](https://fr.wikipedia.org/wiki/%C3%89change_de_cl%C3%A9s_Diffie-Hellman).
![public_key_shared_secret](./img/public_key_shared_secret.png)
#### Authentification
### Authentification
- The server sends a random string of characters to the client
- The client crypt the random string and send it back to the server
......@@ -197,7 +185,7 @@ Can be used to share public keys (see [Diffie-Hellman)](https://fr.wikipedia.org
![private_key_signing](./img/private_key_signing.png)
### SSH Server
## SSH Server
By default, on the IFB, password authentication is disabled to enforce the use of public key based authentication. To learn `ssh` command we are going to enable this option on your VMs. Find the`sshd` configuration file and open it with the editor of your choice.
......@@ -221,9 +209,10 @@ docker run -it --volume /:/root/chroot alpine sh -c "chroot /root/chroot /bin/ba
Using the `sudo` command edit the configuration file to set **PasswordAuthentication** to **yes** and add the following lines:
**AllowUsers etudiant student**
**PermitRootLogin no**
```
AllowUsers etudiant student
PermitRootLogin no
```
The `sshd` (SSH Daemon) process in launched and managed by `systemd`. You can manage `systemd` service with the `systemctl` command. Try this command without any arguments. You can search for `sshd` by typing `/sshd` and pressing `enter`. You can leave the `systemctl` view by pressing `q`.
......@@ -252,9 +241,9 @@ sudo useradd -m -s /bin/bash -g users student
sudo passwd student
```
Give the password and your IP on the chat.
Give the password and your IP to another member of your choice (`ip address show`).
### SSH client
## SSH client
To connect of an SSH server you can use the following command:
......@@ -264,7 +253,7 @@ ssh login@IP_adress
Use this command to connect to another student VM.
On the first connection, `ssh` ask you to accept the public key of the server (key fingerprint). With that in the future if someone try to fool you by impersonating the ssh server, he won’t be able to do it without the corresponding private key.
On the first connection, `ssh` ask you to accept the public key of the server (key fingerprint). With that in the future if someone tries to fool you by impersonating the ssh server, he won’t be able to do it without the corresponding private key.
You can close the connection by pressing `ctrl` + `d` or with the command `exit`.
......@@ -272,7 +261,7 @@ Check the content of the `~/.ssh/` folder, where is saved the server public key
Congratualtion you are connected on a VM through another VM !
#### Key authentication
### Key authentication
Every time, that you want to connect to the ssh server, you have to type your account password, this password is encrypted and send over the network. Instead you can use a pair of private and public key to authenticate yourself.
......@@ -310,13 +299,13 @@ ssh login@IP_adress -i ~/.ssh/id_ed25519_otherVM
Congratulations, you authenticated yourself on a remote server without sending your password over the network !
### SSH based tools
## SSH based tools
Sometime, you want to do other things than executing commands on a remove computer. For example, you may want to transfer files over the network.
#### scp
### scp
The `scp` command comes with the `ssh` client installation you can use it to transfer file from your computer to the ssh sever:
The `scp` command comes with the `ssh` client installation you can use it to transfer files from your computer to the ssh sever:
```sh
scp local/path login@IP_adress:remote/path
......@@ -324,7 +313,7 @@ scp local/path login@IP_adress:remote/path
> You can use a relative remote path, where the ":" correspond to your home folder on the remote server.
You can also retrieve file from the server:
You can also retrieve files from the server:
```sh
scp login@IP_adress:remote/path local/path
......@@ -332,9 +321,9 @@ scp login@IP_adress:remote/path local/path
To transfer directory you can use the `-r` witch
#### rsync
### rsync
`scp` Is a basic command for file transfer. If you want advanced process bar and file integrity checking, you can use the `rsync` command instead.
`scp` is a basic command for file transfer. If you want advanced process bar and file integrity checking, you can use the `rsync` command instead.
For example
......@@ -344,13 +333,13 @@ rsync -auv local/path login@IP_adress:remote/path
Will only transfer files from `local/path` not already present in `remote/path`. The `-c` switch will compute a checksum of the file locally and remotely to be certain that they are identical.
#### sshfs
### sshfs
You can use the `sshfs` command to mount a remote folder over ssh on your computer.
### SSH tips
## SSH tips
#### IFB authentication
### IFB authentication
The default authentication method for the IFB uses keys generated with the `rsa` algorithm
......@@ -364,7 +353,7 @@ Instead of using the `ssh-copy-id` command, you are going to copy paste your pub
You can now use the [RainBio catalogue](https://biosphere.france-bioinformatique.fr/catalogue/) to launch any available VMs and connect to is with SSH from your current VM.
#### SSH configuration
### SSH configuration
Long ssh command can be tedious to use. This is why we are now going to explore the last file in the `.ssh` folder: `.ssh/config`.
......@@ -419,7 +408,6 @@ Host work-ens
With the command `ssh work-ens`, the `ssh` client is going to first connect to `ens` and then from `ens` to the `ip.ip.ip.ip` server.
In the next session, we are going to learn how to [install system-wide programs](./11_install_system_programs.html) like the one managed by `systemd`
> We have used the following commands:
>
......@@ -428,3 +416,4 @@ In the next session, we are going to learn how to [install system-wide programs]
> - scp to copy files
> - rsync to copy files
In the next session, we are going to learn how to [install systemwide programs](./11_install_system_programs.html) like the one managed by `systemd`
11_install_system_programs.Rmd
View file @ e03db036
---
title: Text manipulation
title: Install system programs
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
## Install system programs
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
Objective: Learn how to install programs in GNU/Linux
As we have seen in the [4 unix file system](http://perso.ens-lyon.fr/laurent.modolo/unix/4_unix_file_system.html#lib-and-usrlib) session, programs are files that contain instruction for the computer to do things. Those files can be in binary or text format (with a [shebang](http://perso.ens-lyon.fr/laurent.modolo/unix/9_batch_processing.html#shebang)). Any of those files, present in a folder of the [**PATH**](http://perso.ens-lyon.fr/laurent.modolo/unix/9_batch_processing.html#path) variable are executable anywhere by the user. For system wide installation, the program files are copied within shared folder path containained in the [**PATH**](http://perso.ens-lyon.fr/laurent.modolo/unix/9_batch_processing.html#path) variable.
As we have seen in the [4 Unix file system](http://perso.ens-lyon.fr/laurent.modolo/unix/4_unix_file_system.html#lib-and-usrlib) session, programs are files that contain instruction for the computer to do things. Those files can be in binary or text format (with a [shebang](http://perso.ens-lyon.fr/laurent.modolo/unix/9_batch_processing.html#shebang)). Any of those files, present in a folder of the [**PATH**](http://perso.ens-lyon.fr/laurent.modolo/unix/9_batch_processing.html#path) variable are executable anywhere by the user. For system wide installation, the program files are copied within shared folder path containained in the [**PATH**](http://perso.ens-lyon.fr/laurent.modolo/unix/9_batch_processing.html#path) variable.
Developers don’t want to reinvent the wheel each time they want to write complex instruction in their programs, this is why they use shared library of pre-written complex instruction. This allows for quicker development, fewer bugs (we only have to debug the library once and use it many times), and also [better memory management](http://perso.ens-lyon.fr/laurent.modolo/unix/6_unix_processes.html#processes-tree) (we only load the library once and it can be used by different programs).
### Package Manager
## Package Manager
However, interdependencies between programs and libraries can be a nightmare to handle manually this is why most of the time when you install a program you will use a [package manager](https://en.wikipedia.org/wiki/Package_manager). [Package manager](https://en.wikipedia.org/wiki/Package_manager) are system tools that will handle automatically all the dependencies of a program. They rely on **repositories** of programs and library which contains all the information about the trees of dependence and the corresponding files (**packages**).
However, interdependencies between programs and libraries can be a nightmare to handle manually this is why most of the time when you install a program you will use a [package manager](https://en.wikipedia.org/wiki/Package_manager). [Package managers](https://en.wikipedia.org/wiki/Package_manager) are system tools that will handle automatically all the dependencies of a program. They rely on **repositories** of programs and library which contains all the information about the trees of dependence and the corresponding files (**packages**).
System-wide installation steps:
Systemwide installation steps:
- The user asks the package manager to install a program
- The **package manager** queries its repository lists to search for the most recent **package** version of the program (or a specific version)
- The **package manager** construct the dependency tree of the program
- The **package manager** check that the new dependency tree is compatible with every other installed program
- The **package manager** install the program **package** and all it’s dependencies **packages** in their correct version
- The **package manager** install the program **package** and all its dependencies **packages** in their correct version
The main difference between GNU/Linux distribution is the package manager they use
......@@ -71,9 +53,9 @@ docker run -it --volume /:/root/chroot alpine sh -c "chroot /root/chroot /bin/ba
</p>
</details>
#### Installing R
### Installing R
**R** is a complex program that relies on loots of dependencies. Your current VM run on Ubuntu, so we are going to use the `apt` tool (`apt-get` is the older version of the `apt` command, `synaptic` is a graphical interface for `apt-get`)
**R** is a complex program that relies on loots of dependencies. Your current VM run on Ubuntu, so we are going to use the `apt` tool (`apt-get` is the older version of the `apt` command, `synaptic` is a graphical interface for `apt-get`).
You can check the **r-base** package dependencies on the website [packages.ubuntu.com](https://packages.ubuntu.com/focal/r-base). Not too much dependency ? Check the sub-package **r-base-core**.
......@@ -89,7 +71,7 @@ sudo apt install r-base-core
What is the **R** version that you installed ? Is there a newer version of **R** ?
#### Adding a new repository
### Adding a new repository
You can check the list of repositories that `apt` checks in the file `/etc/apt/sources.list`.
......@@ -107,7 +89,7 @@ Then you must add the public key of this repository:
sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys E298A3A825C0D65DFD57CBB651716619E084DAB9
```
#### Updating the repository list
### Updating the repository list
You can now use `apt` to update your repository list dans try to reinstall **r-base-core**
......@@ -143,7 +125,7 @@ sudo apt search linux-image
#### Language specific package manager
### Language specific package manager
If it’s not a good idea to have different **package manager** on the same system (they don’t know how the dependencies are handled by the other’s manager). You will also encounter language specific package manager:
......@@ -154,7 +136,7 @@ If it’s not a good idea to have different **package manager** on the same syst
- `install.packages` for R
- ...
These **package managers** allows your to make installation local to the user, which is advisable to avoid any conflict with the **packages manager** of the system.
These **package managers** allow you to make installation local to the user, which is advisable to avoid any conflict with the **packages manager** of the system.
For example, you can use the following command to install `glances` system wide with `pip`
......@@ -170,7 +152,7 @@ Next-time use `pip` with the `--user` switch.
### Manual installation
## Manual installation
Sometimes, a specific tool that you want to use will not be available through a **package manager**. If you are lucky, you will find a **package** for your distribution. For `apt` the **package** are `.deb` files.
......@@ -186,7 +168,7 @@ wget https://github.com/Automattic/simplenote-electron/releases/download/v2.7.0/
You can then use `apt` to install this file.
### From sources
## From sources
If the program is open source, you can also [download the sources](https://github.com/Automattic/simplenote-electron/archive/v2.7.0.tar.gz) and build them.
......@@ -200,7 +182,7 @@ wget https://github.com/Automattic/simplenote-electron/archive/v2.7.0.tar.gz
You can use the command `tar -xvf` to extract this archive
When you go into the `simplenote-electron-2.7.0` folder, you can see a `Makefile` this means that you can use the `make` command to build Simplenote from those files. `make` Is a tool that read recipes (`Makefiles`) to build programs.
When you go into the `simplenote-electron-2.7.0` folder, you can see a `Makefile` this means that you can use the `make` command to build Simplenote from those files. `make` is a tool that read recipes (`Makefiles`) to build programs.
You can try to install `node` and `npx` with `apt`. What happened ?
......@@ -251,7 +233,6 @@ You can finalize the installation with the command `make install`. Usually the c
Read the `README` file of the [fastp](https://github.com/OpenGene/fastp) program to see which methods of installation are available.
Installing programs and maintain different versions of a program on the same system, is a difficult task. In the next session, we will learn how to use [virtualization](./12_virtualization.html) to facilitate our job.
> We have used the following commands:
>
......@@ -261,4 +242,5 @@ Installing programs and maintain different versions of a program on the same sys
> - make to build programs from sources
Installing programs and maintain different versions of a program on the same system is a difficult task. In the next session, we will learn how to use [virtualization](./12_virtualization.html) to facilitate our job.
12_virtualization.Rmd
View file @ e03db036
---
title: Text manipulation
title: Virtualization
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
## Install system programs
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
Objective: Learn how to build virtual images or container of a system
......@@ -48,21 +30,21 @@ To avoid the overhead of simulating every component of the **guest** system, whi
There are different levels of virtualisation which correspond to different levels of isolation between the virtual machine (**guest**) and the real computer (**host**).
### Full virtualization
## Full virtualization
A key challenge for full virtualization is the interception and simulation of privileged operations, such as I/O instructions. The effects of every operation performed within a given virtual machine must be kept within that virtual machine – virtual operation cannot be allowed to alter the state of any other virtual machine, the control program, or the hardware. Some machine instructions can be executed directly by the hardware, since their effects are entirely contained within the elements managed by the control program, such as memory locations and arithmetic registers. But other instructions that would "pierce the virtual machine" cannot be allowed to execute directly; they must instead be trapped and simulated. Such instructions either access or affect state information that is outside the virtual machine.
### Paravirtualization
## Paravirtualization
In paravitualization, the virtual hardware of the **guest** system is similar to the hardware of the **host**. The goal is to reduce the portion of the **guest** execution time spent to simulate hardware which is the same as the **host** hardware. The paravirtualization provides specially defined **hooks** to allow the **guest** and **host** to request and acknowledge these tasks, which would otherwise be executed in the virtual domain (where execution performance is worse).
A hypervisor provides the virtualization of the underlying computer system. In [full virtualization](https://en.wikipedia.org/wiki/Full_virtualization), a guest operating system runs unmodified on a hypervisor. However, improved performance and efficiency is achieved by having the guest operating system communicate with the hypervisor. By allowing the guest operating system to indicate its intent to the hypervisor, each can cooperate to obtain better performance when running in a virtual machine. This type of communication is referred to as paravirtualization.
### OS-level virtualization
## OS-level virtualization
**OS-level virtualization** is an [operating system](https://en.wikipedia.org/wiki/Operating_system) paradigm in which the [kernel](https://en.wikipedia.org/wiki/Kernel_(computer_science)) allows the existence of multiple isolated [user space](https://en.wikipedia.org/wiki/User_space) instances. Such instances, called **containers** may look like real computers from the point of view of programs running in them. Programs running inside a container can only see the container's contents and devices assigned to the container.
### VirtualBox
## VirtualBox
VirtualBox is own by oracle, you can add the following repository to get the last version:
......@@ -81,13 +63,13 @@ sudo apt install virtualbox
sudo usermod -G vboxusers -a $USER
```
The first things that we need to do with virtual box is to create a new virtual machine. We want to install Ubuntu 20.04 on it.
The first thing that we need to do with virtual box is to create a new virtual machine. We want to install Ubuntu 20.04 on it.
```sh
VBoxManage createvm --name Ubuntu20.04 --register
```
We the create a virtual hard disk for this VM:
We create a virtual hard disk for this VM:
```sh
VBoxManage createhd --filename Ubuntu20.04 --size 14242
......@@ -105,7 +87,7 @@ We set the virtual RAM
VBoxManage modifyvm Ubuntu20.04 --memory 1024
```
We add an vitual IDE periferic storage on which we can boot on
We add a virtual IDE peripheric storage on which we can boot on.
```sh
VBoxManage storagectl Ubuntu20.04 --name IDE --add ide --controller PIIX4 --bootable on
......@@ -132,7 +114,7 @@ VBoxManage startvm Ubuntu20.04
Why did this last command fail ? Which kind of virtualisation VirtualBox is using ?
### Docker
## Docker
Docker is an **OS-level virtualization** system where the virtualization is managed by the `docker` daemon.
......@@ -140,7 +122,7 @@ You can use the `systemctl` command and the `/` key to search for this daemon.
Like VirtualBox, you can install system programs within a container.
Prebuilt container can be found on different sources like [the docker hub](https://hub.docker.com/) or [the biocontainers registry](https://biocontainers.pro/registry).
Prebuilt containers can be found on different sources like [the docker hub](https://hub.docker.com/) or [the biocontainers registry](https://biocontainers.pro/registry).
Launching a container
......@@ -196,7 +178,7 @@ docker rmi rocker/rstudio:3.2.0
Try to run the `mcr.microsoft.com/windows/servercore:ltsc2019` container, what is happening ?
#### Building your own container
### Building your own container
You can also create your own container by writing a container recipe. For Docker this file is named `Dockerfile`
......@@ -228,7 +210,7 @@ docker build ./ -t 'ubuntu_with_htop'
### Singularity
## Singularity
Like Docker, Singularity is an **OS-level virtualization**. This main difference with docker is that the user is the same within and outside a container. Singularity is available on the [neuro.debian.net](http://neuro.debian.net/install_pkg.html?p=singularity-container) repository, you can add this source with the following commands:
......
1_understanding_a_computer.Rmd
View file @ e03db036
---
title: Understanding a computer
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
......@@ -77,7 +59,7 @@ Objective: understand the relations between the different components of a comput
## As simple as a Turing machine ?
![universal_truing_machine](./img/universal_truing_machine.png){width=100%}
![Universal Truing Machine](./img/universal_truing_machine.png){width=100%}
- A tape divided into cells, one next to the other. Each cell contains a symbol from some finite alphabet.
- A head that can read and write symbols on the tape and move the tape left and right one (and only one) cell at a time.
......@@ -124,7 +106,7 @@ Disadvantages:
> The kernel provides the most basic level of control over all of the computer's hardware devices. It manages memory access for programs in the RAM, it determines which programs get access to which hardware resources, it sets up or resets the CPU's operating states for optimal operation at all times, and it organizes the data for long-term non-volatile storage with file systems on such media as disks, tapes, flash memory, etc.
[Kernel](./img/220px-Kernel_Layout.svg.png){width=100%}
![Kernel](./img/220px-Kernel_Layout.svg.png){width=100%}
---
......@@ -160,7 +142,7 @@ You can find a [list of software licenses](https://www.gnu.org/licenses/license-
Your browser does not support the video tag.
</video>
See this [presentation](https://plmlab.math.cnrs.fr/gdurif/presentation_foss/-/blob/main/presentation/presentation_DURIF_foss.pdf) (in french) for a quick introduction about **software license** and **free/open source software**.
## session 2 IFB Cloud
[Instead of installing GNU/Linux on your computer, you are going to learn to use the IFB Cloud.](./2_using_the_ifb_cloud.html)
2_using_the_ifb_cloud.Rmd
View file @ e03db036
---
title: IFB (Institu Français de bio-informatique) Cloud
title: IFB (Institut Français de bio-informatique) Cloud
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
## IFB (Institu Français de bio-informatique) Cloud
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
Objective: Start and connect to an appliance on the IFB cloud
Instead of working on your computer where you don't have an Unix-like OS or have limited right, we are going to use the [IFB (Institu Français de bio-informatique) Cloud]( https://biosphere.france-bioinformatique.fr/).
Instead of working on your computer where you don't have an Unix-like OS or have limited right, we are going to use the [IFB (Institut Français de bio-informatique) Cloud]( https://biosphere.france-bioinformatique.fr/).
### Creating an IFB account
## Creating an IFB account
1. Access the [**https://biosphere.france-bioinformatique.fr/**](https://biosphere.france-bioinformatique.fr/) website
2. On the top right (First) steps with GNU/Linux
Instead of working on your computer where you don't have an Unix-like OS or have limited right, we are going to use the [IFB (Institu Français de bio-informatique) Cloud]( https://biosphere.france-bioinformatique.fr/). For this you will need:
1. Access the [**https://biosphere.france-bioinformatique.fr/**](https://biosphere.france-bioinformatique.fr/) website
2. On the top right of the screen click on <img src="./img/signin_ifb.png" alt="sign in" style="zoom:150%;" />
3. Then click on ![login](./img/login_ifb.png)
4. Use the **Incremental search field** to select your identity provider (CNRS / ENS de Lyon / etc.)
5. Login
6. Complete the form with your **Name**, **First Name**, **Town** and **Zip Code**. You can ignore the other field and click on **accept**.
7. Go to your **Groups** parameters on the top right ![group_selection_ifb](./img/group_selection_ifb.png)
8. Click on ![join_a_group](./img/join_a_group.png) and type **LBMC Unix 2020**
8. Click on ![join_a_group](./img/join_a_group.png) and type **CAN UNIX 2023**
9. You can click on the **+** sign to register and wait to be accepted in the group
### Starting the LBMC Unix 2020 appliance
## Starting the LBMC Unix 2022 appliance
To follow this practical you will need to start the **[LBMC Unix 2020](https://biosphere.france-bioinformatique.fr/catalogue/appliance/177/)** appliance from the [IFB Cloud](https://biosphere.france-bioinformatique.fr/) and click on the ![start](./img/start_VM.png) button after login with your account.
To follow this practical you will need to start the **[LBMC Unix 2022](https://biosphere.france-bioinformatique.fr/catalogue/appliance/177/)** appliance from the [IFB Cloud](https://biosphere.france-bioinformatique.fr/) and click on the ![start](./img/start_VM.png) button after login with your account.
In the IFB jargon, appliance means **virtual machine** (VM). Remember how a universal Turing machine can run any programs ? A virtual machine, is a simulation program, simulating a physical computer. VM's have the following advantages:
- Copies of the VM will be identical (there will be no differences between your running *LBMC Unix 2020 appliance* and mine )
- Upon starting the VM is reset to the *LBMC Unix 2020 appliance* state
- Copies of the VM will be identical (there will be no differences between your running *LBMC Unix 2022 appliance* and mine )
- Upon starting the VM is reset to the *LBMC Unix 2022 appliance* state
- You can break everything in your VM, terminate it and start a new one.
To access to your appliance you can go to the [**myVM** tab](https://biosphere.france-bioinformatique.fr/cloud/)
......@@ -84,7 +56,7 @@ You will need to start this appliance at the start of each session of this cours
The ![hourglass](./img/wait_my_appliances_ifb.png) symbol indicates that your appliance is starting.
### Accessing the LBMC Unix 2020
## Accessing the LBMC Unix 2022
You can open the **https** link next to the termination button of your appliance in a new tab. You will have the following message
......
3_first_steps_in_a_terminal.Rmd
View file @ e03db036
---
title: First step in a terminal
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
## First step in a terminal
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
Objective: learn to use basic terminal command
Congratulations you are now connected on your VM !
......@@ -50,34 +28,35 @@ What is the distribution installed on your VM ?
You can go to this distribution website and have a look at the list of firms using it.
### Shell
## Shell
A command-line interpreter (or shell), is a software designed to read lines of text entered by a user to interact with an OS.
To simplify the shell executes the following infinite loop:
1. read a line
2. translate this line as a program execution with its parameters
3. launch the corresponding program with the parameters
3. wait for the program to finish
4. Go back to 1.
When you open a terminal on an Unix-like OS, you will have a **prompt** displayed: it can end with a **$** or a **%** character depending on your configuration. As long as you see your prompt, it means that you are in step **1.**, if no prompt is visible, you are in step **4.** or you have set up a very minimalist configuration for your shell.
When you open a terminal on an Unix-like OS, you will have a **prompt** displayed: it can end with a `$` or a `%` character depending on your configuration. As long as you see your prompt, it means that you are in step **1.**, if no prompt is visible, you are in step **4.** or you have set up a very minimalist configuration for your shell.
<img src="./img/prompt.png" alt="prompt" style="zoom:150%;" />
The blinking square or vertical bar represents your **cursor**. Shell predates graphical interfaces, so most of the time you won’t be able to move this cursor with your mouse, but with the directional arrows (left and right).
The blinking square or vertical bar represents your **cursor**. Shell predates graphical interfaces, so most of the time you won’t be able to move this cursor with your mouse, but with the **directional arrows** (left and right).
On the IFB, your prompt is a **$**
On the IFB, your prompt is a `$`:
```sh
etudiant@VM:~$
```
You can identify the following information from your prompt: **etudiant** is your login and **VM** is the name of your VM (**~** is where you are on the computer, but we will come back to that later).
You can identify the following information from your prompt: **etudiant** is your login and **VM** is the name of your VM (`~` is where you are on the computer, i.e. the current working directory, but we will come back to that later).
On Ubuntu 20.04, the default shell is [Bash](https://en.wikipedia.org/wiki/Bash_(Unix_shell)) while on recent version of macOS it’s [zsh](https://en.wikipedia.org/wiki/Z_shell). There are [many different shell](https://en.wikipedia.org/wiki/List_of_command-line_interpreters), for example, Ubuntu 20.04 also has [sh](https://en.wikipedia.org/wiki/Bourne_shell) installed.
### Launching Programs
## Launching Programs
You can launch every program present on your computer from the shell. The syntax will always be the following:
......@@ -127,7 +106,7 @@ cal 2 1999
What is the difference for the parameter value `2` in the first and third command ?
### Moving around
## Moving around
For the `cal` program, the position in the file system is not important (it’s not going to change the calendar). However, for most tools that are able to read or write files, it’s important to know where you are. This is the first real difficulty with command line interface: you need to remember where you are.
......@@ -159,7 +138,7 @@ What happens when you type `cd` without any argument ?
What is the location shown in your prompt ? Is it coherent with the `pwd` information ? Can you `cd` to the `pwd` path ?
When we move around a file system, we often want to see what is in a given folde. We want to **l**i**s**t the directory content. Go back to the `/home` directory and use to the `ls` command see how many have a home directory there.
When we move around a file system, we often want to see what is in a given folder. We want to **l**i**s**t the directory content. Go back to the `/home` directory and use to the `ls` command see how many people have a home directory there.
We will see various options for the `ls` command, throughout this course. Try the `-a` option.
......@@ -169,9 +148,9 @@ ls -a
What changed compared to the `ls` command without this option ?
Go to your home folder with the bare `cd` command and run the `ls -a` command again. The `-a` option makes the `ls` command list hidden files and folders. On Unix systems, hidden files and folders are all files and folders whose name starts with a "**.**".
Go to your home folder with the bare `cd` command and run the `ls -a` command again. The `-a` option makes the `ls` command list hidden files and folders. On Unix systems, hidden files and folders are all files and folders whose name starts with a `.`.
Can you `cd` to "**.**" ?
Can you `cd` to `.` ?
```sh
cd .
......@@ -179,7 +158,7 @@ cd .
What happened ?
Can you cd to "**..**" ?
Can you cd to `..` ?
```sh
cd ..
......
4_unix_file_system.Rmd
View file @ e03db036
---
title: GNU/Linux file system
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
## GNU/Linux file system
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
Objective: Understand how files are organized in Unix
> On a UNIX system, everything is a file ; if something is not a file, it is a process.
......@@ -60,19 +38,19 @@ This file system is organized as a tree. As you have seen, every folder has a pa
Every file can be accessed by an **absolute path** starting at the root. Your user home folder can be accessed with the path `/home/etudiant/`. Go to your user home folder.
We can also access file with a **relative path**, using the special folder "**..**". From your home folder, go to the *ubuntu* user home folder without passing by the root (we will see use of the "**.**" folder later).
We can also access files with a **relative path**, using the special folder `..`. From your home folder, go to the *ubuntu* user home folder without passing by the root (we will see use of the `.` folder later).
### File Types
## File Types
As you may have guessed, every file type is not the same. We have already seen that common file and folder are different. Here are the list of file types:
As you may have guessed, every file type is not the same. We have already seen that common file and folder are different. Here is the list of file types:
- **-** common files
- **d** folders
- **l** links
- **b** disk
- **c** special files
- **s** socket
- **p** named pipes
- `-` common files
- `d` folders
- `l` links
- `b` disk
- `c` special files
- `s` socket
- `p` named pipes
To see the file type you can type the command
......@@ -80,61 +58,61 @@ To see the file type you can type the command
ls -la
```
The first column will tell you the type of the file (here we have only the type "**-**" and "**d**" ). We will come back on the other information later. An other less used command to get fine technical information on a file is the command `stat [file_name]`. Can you get the same information as `ls -la` with `stat` ?
The first column will tell you the type of the file (here we have only the type `-` and `d`). We will come back on the other information later. Another less used command to get fine technical information on a file is the command `stat [file_name]`. Can you get the same information as `ls -la` with `stat` ?
### Common Structure
## Common Structure
From the root of the system (**/**), most of the Unix-like distribution will share the same folder arborescence. On macOS, the names will be different because when you sell the most advanced system in the world you need to rename things, with more advanced names.
From the root of the system (`/`), most of the Unix-like distribution will share the same folder tree structure. On macOS, the names will be different because when you sell the most advanced system in the world you need to rename things, with more advanced names.
#### `/home`
### `/home`
You already know this one. You will find all your file and your configuration files here. Which configuration file can you identify in your home ?
#### `/boot`
### `/boot`
You can find the Linux kernel and the boot manager there. What is the name of your boot manager (process by elimination) ?
You can see a new type of file here, the type "**l**". What it the version of the **vmlinuz** kernel ?
You can see a new type of file here, the type `l`. What it the version of the **vmlinuz** kernel ?
#### `/root`
### `/root`
The home directory of the super user, also called root (we will go back on him later). Can you check its configuration file ?
#### `/bin`, `/sbin`, `/usr/bin` and `/opt`
### `/bin`, `/sbin`, `/usr/bin` and `/opt`
The folder containing the programs used by the system and its users. Programs are simple file readable by a computer, these files are often in **bin**ary format which means that it’s extremely difficult for a human to read them.
What is the difference between **/bin** and **/usr/bin** ?
What is the difference between `/bin` and `/usr/bin` ?
**/sbin** stand for system binary. What are the names of the programs to power off and restart your system ?
`/sbin` stand for system binary. What are the names of the programs to power off and restart your system ?
**/opt** is where you will find the installation of non-conventional programs (if you don’t follow [the guide of good practice of the LBMC](http://www.ens-lyon.fr/LBMC/intranet/services-communs/pole-bioinformatique/ressources/good_practice_LBMC), you can put your bioinformatics tools with crapy installation procedure there).
`/opt` is where you will find the installation of non-conventional programs (if you don’t follow [the guide of good practice of the LBMC](http://www.ens-lyon.fr/LBMC/intranet/services-communs/pole-bioinformatique/ressources/good_practice_LBMC), you can put your bioinformatics tools with crapy installation procedure there).
#### `/lib` and `/usr/lib`
### `/lib` and `/usr/lib`
Those folder contains system libraries. Libraries are a collection of pieces of codes usable by programs.
What is the difference between **/lib** and **/usr/lib**.
What is the difference between `/lib` and `/usr/lib`.
Search information on the `/lib/gnupg` library on the net.
#### `/etc`
### `/etc`
The place where system configuration file and default configuration file are. What is the name of the default configuration file for `bash` ?
#### `/dev`
### `/dev`
Contains every peripheric
What is the type of the file `stdout` (you will have to follow the links)?
With the command `ls -l` can you identify files of type "**b**" ?
With the command `ls -l` can you identify files of type `b` ?
Using `less` can you visualize the content of the file `urandom` ? What about the file `random` ?
What is the content of `/dev/null`?
#### `/var`
### `/var`
Storage space for variables and temporary files, like system logs, locks, or file waiting to be printed...
......@@ -148,15 +126,15 @@ You can navigate the file with the navigation arrows. Which group the user `ubun
To close the `less` you can press `Q`. Try the opposite of `less`, what are the differences ?
What is the type of the file `autofs.fifo-var-autofs-ifb` in the `run` folder ? From **fifo** in the name, can you guess the function of the "**p**" file ?
What is the type of the file `autofs.fifo-var-autofs-ifb` in the `run` folder ? From **fifo** in the name, can you guess the function of the `p` file ?
There are few examples of the last type of file in the `run` folder, in which color the command `ls -l` color them ?
#### `/tmp`
### `/tmp`
Temporary space. **Erased at each shutdown of the system !**
#### `/proc`
### `/proc`
Information on the system resources. This file system is virtual. What do we mean by that ?
......@@ -168,7 +146,7 @@ From the `cpuinfo` file get the brand of the cpu simulated by your VM.
From the `meminfo` file retrieve the total size of RAM
### Links
## Links
With the command `ls -l` we have seen some links, the command `stat` can give us more information on them
......@@ -178,7 +156,7 @@ stat /var/run
What is the kind of link for `/var/run` ?
Most of the time, when you are going to work with links, you will work with this kind of link. You can create a **l**i**n**k with the command `ln` and the option `-s` for **s**ymbolic.
Most of the time, when you are going to work with links, you will work with this kind of link. You can create a **l**i**n**k with the command `ln` and the option `-s` for a **s**ymbolic.
The first argument after the option of the `ln` command is the target of the link, the second argument is the link itself:
......@@ -214,13 +192,13 @@ ln .bashrc bashrc_linkb
Use `stat` to also study `bashrc_linka` and `bashrc_linkb`.
What happen when you delete `bashrc_linka` ?
What happens when you delete `bashrc_linka` ?
To understand the notion of **Inode** we need to know more about storage systems.
### Disk and partition
## Disk and partition
On a computer, the data are physically stored on a media (HDD, SSD, USB key, punch card...)
......@@ -232,11 +210,11 @@ You cannot dump data directly into the disk, you need to organize things to be a
![disk](./img/disk.png)
Each media is divided into partition:
Each media is divided into partitions:
![partitions](./img/partition.png)
The media is divided into one or many partition, each of which have a file system type. Examples of file system type are:
The media is divided into one or many partition, each of which have a file system type. Examples of file system types are
- fat32, exFAT
- ext3, ext4
......@@ -257,8 +235,8 @@ Find which disk is mounted at the root of the file tree.
> We have seen the commands:
>
> - `stat` to display information on a file
> - `less` to visualise the content of a file
> - `ln` to create link
> - `less` to visualize the content of a file
> - `ln` to create links
> - `mount` to list mount points
[That’s all for the Unix file system, we will come back to it from time to time but for now you can head to the next section.](./5_users_and_rights.html)
5_users_and_rights.Rmd
View file @ e03db036
---
title: Users and rights
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
## Users and rights
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
Objective: Understand how rights works in GNU/Linux
......@@ -50,7 +32,7 @@ There can also be other users who
- belong to groups
- the groups also have rights
### File rights
## File rights
Each file is associated with a set of rights:
......@@ -65,7 +47,7 @@ Check your set of rights on your `.bashrc` file
ls -l ~/.bashrc
```
The first column of the `ls -l` output show the status of the rights on the file
The first column of the `ls -l` output shows the status of the rights on the file
![user_rights](./img/user_right.png)
......@@ -123,7 +105,7 @@ What can you conclude on the symbols `+` , `=`, `-` and `,` with the `chmod` com
> | `-r--r--r--` | 0444 | read |
> | `-r-xr-xr-x` | 0555 | read & execute |
> | `-rw-rw-rw-` | 0666 | read & write |
> | `-rwxr-----` | 0740 | owner can read, write, & execute; group can only read; others have no permissions |
> | `-rwxr-----` | 0740 | owner can read, write, & execute; group can only read; others have no permission |
The default group of your user is the first in the list of the groups you belong to. You can use the command `groups` to display this list. What is your default group ?
......@@ -155,7 +137,7 @@ Create a symbolic link (`ln -s`) to your **.bashrc** file, what are the default
Can you remove the writing right of this link ? What happened ?
### Users and Groups
## Users and Groups
We have seen how to change the right associated with the group, but what about changing the group itself ? The command `chgrp` allows you to do just that:
......@@ -189,7 +171,7 @@ Copy the `mkdir` tool to your home directory. Can you remove execution rights fo
You cannot change the owner of a file, but you can always allow another user to copy it and change the rights on its copy.
### Getting admin access
## Getting admin access
Currently you don’t have administrative access to your VM, this means that you don’t have the password to the *root* account. Another way to get administrative access in Linux is to use the `sudo` command.
......@@ -227,7 +209,7 @@ You can try again the `chown` command with the `sudo` command.
Check the content of the file `/etc/shadow` , what is the utility of this file (you can get help from the `man` command).
### Creating Users
## Creating Users
You can add a new user to your system with the command `useradd`
......@@ -235,14 +217,14 @@ You can add a new user to your system with the command `useradd`
useradd -m -s /bin/bash -g users -G adm,docker student
```
- `-m` create a hone directory
- `-m` create a home directory
- `-s` specify the shell to use
- `-g` the default group
- `-G` the additional groups
To log into another account you can use the command `su`
What is the difference between the two following command ?
What is the difference between the two following commands ?
```sh
su student
......@@ -254,7 +236,7 @@ sudo su student
What append when you don't specify a login with the `su` command ?
### Creating groups
## Creating groups
You can add new groups to your system with the command `groupadd`
......@@ -262,7 +244,7 @@ You can add new groups to your system with the command `groupadd`
sudo groupadd dummy
```
Then you can add users to these group with the command `usermod`
Then you can add users to this group with the command `usermod`
```sh
sudo usermod -a -G dummy student
......@@ -274,7 +256,7 @@ And check the result:
groups student
```
To remove an user from a group you can rewrite it's list of group with the command `usermod`
To remove an user from a group you can rewrite its list of groups with the command `usermod`
```sh
sudo usermod -G student student
......@@ -282,11 +264,11 @@ sudo usermod -G student student
Check the results.
### Security-Enhanced Linux
## Security-Enhanced Linux
While what you have seen in this section hold true for every Unix system, additionnal rules can be applied to control the rights in Linux. This is what is called [SE Linux](https://en.wikipedia.org/wiki/Security-Enhanced_Linux) (**s**ecurity-**e**nhanced **Linux**)
While what you have seen in this section hold true for every Unix system, additional rules can be applied to control the rights in Linux. This is what is called [SE Linux](https://en.wikipedia.org/wiki/Security-Enhanced_Linux) (**s**ecurity-**e**nhanced **Linux**)
When SE Linux is enabled on a system, every **processes** can be assigned a set of right. This is how, on Android for example, some programs can access your GPS while other cannot etc. In this case it's not the user rights that prevail, but the **process** launched by the user.
When SE Linux is enabled on a system, every **process** can be assigned a set of rights. This is how, on Android for example, some programs can access your GPS while others cannot, etc. In this case it's not the user rights that prevail, but the **process** launched by the user.
> We have seen the commands:
>
......@@ -300,6 +282,6 @@ When SE Linux is enabled on a system, every **processes** can be assigned a set
> - `sudo` to borrow **root** rights
> - `groupadd` to create groups
> - `groups` to list groups
> - `usermod`to manipulate user's to groups
> - `usermod`to manipulate users' groups
[To understand more about processes you can head to the next section.](./6_unix_processes.html)
6_unix_processes.Rmd
View file @ e03db036
This diff is collapsed.
7_streams_and_pipes.Rmd
View file @ e03db036
---
title: Unix Streams and pipes
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
## Steams and pipes
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
Objective: Understand function of streams and pipes in Unix systems
......@@ -62,9 +44,9 @@ cat .bashrc
### Streams manipulation
## Streams manipulation
You can use the `>` character to redirect a flux toward a file. The following command make a copy of your `.bashrc` files.
You can use the `>` character to redirect a flux toward a file. The following command makes a copy of your `.bashrc` files.
```sh
cat .bashrc > my_bashrc
......@@ -84,11 +66,11 @@ cal -N 2 > my_cal
What is the content of `my_cal` what happened ?
The `>` command can have an argument, the syntax to redirect **stdout** to a file is `1>` it's also the default option (equivalent to `>`). Here the `-N` option doesn't exists, `cal` throws an error. Errors are sent to **stderr** which have the number 2.
The `>` command can have an argument, the syntax to redirect **stdout** to a file is `1>` it's also the default option (equivalent to `>`). Here the `-N` option doesn't exist, `cal` throws an error. Errors are sent to **stderr** which have the number 2.
Save the error message in `my_cal` and check the results with `less`.
We have seen tha `>` overwrite the content of the file. Try the following commands:
We have seen that `>` overwrite the content of the file. Try the following commands:
```sh
cal 2020 > my_cal
......@@ -98,7 +80,7 @@ cal -N 2 2>> my_cal
Check the results with the command `less`.
The command `>` send the stream from the left to the file on the right. Try the following:
The command `>` sends the stream from the left to the file on the right. Try the following:
```sh
cat < my_cal
......@@ -116,7 +98,7 @@ Type some text and type `EOF` on a new line. `EOF` stand for **e**nd **o**f **f*
What happened ? Can you check the content of `my_notes` ? How would you modify this command to add new notes?
Finaly you can redirect a stream toward another stream with the following syntax:
Finally, you can redirect a stream toward another stream with the following syntax:
```sh
cal -N2 2&> my_redirection
......@@ -125,7 +107,7 @@ cal 2&>> my_redirection
### Pipes
## Pipes
The last stream manipulation that we are going to see is the pipe which transforms the **stdout** of a process into the **stding** of the next. Pipes are useful to chain multiples simple operations. The pipe operator is `| `
......@@ -157,7 +139,7 @@ Analyze the following command, what would it do ?
wget -q -O - http://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz | gzip -dc | less
```
Remember that most Unix command process input and output line by line. Which means that you can process huge dataset without intermediate files or huge RAM capacity.
Remember that most Unix command process input and output line by line. Which means that you can process huge datasets without intermediate files or huge RAM capacity.
> We have users the following commands:
>
......
8_text_manipulation.Rmd
View file @ e03db036
---
title: Text manipulation
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
## Text manipulation
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
Objective: Learn basics way to work with text file in Unix
Objective: Learn simple ways to work with text file in Unix
One of the great thing with command line tools is that they are simple and fast. Which means that they are great for handle large files. And as bioinformaticians you have to handle large file, so you need to use command line tools for that.
One of the great things with command line tools is that they are simple and fast. Which means that they are great for handling large files. And as bioinformaticians you have to handle large files, so you need to use command line tools for that.
### Text search
## Text search
The file [hg38.ncbiRefSeq.gtf.gz](http://hgdownload.soe.ucsc.edu/goldenPath/hg38/bigZips/genes/hg38.ncbiRefSeq.gtf.gz) contains the RefSeq annotation for hg38 in [GFT format](http://www.genome.ucsc.edu/FAQ/FAQformat.html#format4)
We can download files with the `wget` command. Here the annotation is in **gz** format which is a compressed format, you can use the `gzip` tool to hande **gz** files.
We can download files with the `wget` command. Here the annotation is in **gz** format which is a compressed format, you can use the `gzip` tool to handle **gz** files.
On useful command to check large text file is the `head `command.
......@@ -64,15 +46,15 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | grep "chr2" | head
What is the last annotation on the chromosome 1 (to write a tabulation character you can type `\t`) ?
You can count things in text file with the command `wc` read the `wc` **man**ual to see how you can count line in a file.
You can count things in text file with the command `wc` read the `wc` **man**ual to see how you can count lines in a file.
Does the number of *3UTR* match the number of *5UTR* ?
How many transcripts does the gene *CCR7* have ?
### Regular expression
## Regular expression
When you do a loot text search, you will encounter regular expression (regexp), which allow you to perform fuzzy search. To run `grep` in regexp mode you can use the switch `-E`
When you do a loot text search, you will encounter regular expressions (regexp), which allow you to perform fuzzy search. To run `grep` in regexp mode you can use the switch. `-E`
The most basic form fo regexp si the exact match:
......@@ -80,7 +62,7 @@ The most basic form fo regexp si the exact match:
gzip -dc hg38.ncbiRefSeq.gtf.gz | head | grep -E "gene_id"
```
You can use the `.` wildcard character to match any thing
You can use the `.` wildcard character to match anything
```sh
gzip -dc hg38.ncbiRefSeq.gtf.gz | head | grep -E "...._id"
......@@ -92,7 +74,7 @@ There are different special characters in regexp, but you can use `\` to escape
gzip -dc hg38.ncbiRefSeq.gtf.gz | head | grep -E "\."
```
#### Character classes and alternatives
### Character classes and alternatives
There are a number of special patterns that match more than one character. You’ve already seen `.`, which matches any character apart from a newline. There are four other useful tools:
......@@ -113,11 +95,11 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | head | perl -E "\d\d[A-Z]\d"
</p>
</details>
#### Anchors
### Anchors
By default, regular expressions will match any part of a string. It’s often useful to *anchor* the regular expression so that it matches from the start or end of the string. You can use
- ^` to match the start of the string.
- `^` to match the start of the string.
- `$` to match the end of the string.
```sh
......@@ -130,7 +112,7 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | head | grep -E "c"
gzip -dc hg38.ncbiRefSeq.gtf.gz | head | grep -E "^c"
```
#### Repetition
### Repetition
The next step up in power involves controlling how many times a pattern matches
......@@ -167,7 +149,7 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | grep -E "transcript\s.*gene_id\s\"\S{16,}\";"
</p>
</details>
#### Grouping and back references
### Grouping and back references
You can group match using `()`, for example the following regexp match doublet of *12* .
......@@ -192,9 +174,9 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | head | sed -E 's|ncbiRefSeq(.*)(transcript_id
```
</p>
</details>
Regexp can be very complexe see for example [a regex to validate an email on starckoverflow](https://stackoverflow.com/questions/201323/how-to-validate-an-email-address-using-a-regular-expression/201378#201378). When you start you can always use for a given regexp to a more experienced used (just give him the kind of text you want to match and not match). You can test your regex easily with the [regex101 website](https://regex101.com/).
Regexp can be very complex see for example [a regex to validate an email on starckoverflow](https://stackoverflow.com/questions/201323/how-to-validate-an-email-address-using-a-regular-expression/201378#201378). When you start you can always use for a given regexp to a more experienced used (just give him the kind of text you want to match and not match). You can test your regex easily with the [regex101 website](https://regex101.com/).
### Sorting
## Sorting
GTF files should be sorted by chromosome, starting position and end position. But you can change that with the command `sort` to select the column to sort on you can use the option `-k n,n` where `n` is the column number.
......@@ -238,7 +220,7 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | head -n 10000 | sort -k 1,1 -k 4,4n -k 5,5n -c
### Field extractor
## Field extractor
Sometime rather than using complex regexp, we want to extract a particular column from a file. You can use the command `cut` to do that.
......@@ -257,7 +239,7 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | head | cut -f 2 -f 5 -d ";"
```
</p>
</details>
### Concatenation
## Concatenation
There are different tools to concatenate files from the command line `cat` for vertical concatenation and `paste` for horizontal concatenation.
......@@ -273,7 +255,7 @@ gzip -dc hg38.ncbiRefSeq.gtf.gz | head | paste - -
### Text editor
## Text editor
You often have access to different text editors from the common line, two of the most popular ones are `vim` and `nano`.
......@@ -293,9 +275,7 @@ You have 3 modes in `vim`:
- The **insert** mode, where you can write things. You enter this mode with the `i` key or any other key insertion key (for example `a` to insert after the cursor or `A` to insert at the end of the line)
- The **visual** mode where you can select text for copy/paste action. You can enter this mode with the `v` key
If you want to learn more about `vim` you can start with the https://vim-adventures.com/ website. Once you master `vim` everything is faster but you will have to practice a loot.
In the next session, we are going to apply the logic of pipes and text manipulation to [batch processing.](./9_batch_processing.html)
If you want to learn more about `vim`, you can start with the <https://vim-adventures.com/> website. Once you master `vim` everything is faster but you will have to practice a lot.
> We have used the following commands:
>
......@@ -310,3 +290,5 @@ In the next session, we are going to apply the logic of pipes and text manipulat
> - `cat` / `paste` for concatenation
> - `nano` / `vim` for text edition
In the next session, we are going to apply the logic of pipes and text manipulation to [batch processing.](./9_batch_processing.html)
9_batch_processing.Rmd
View file @ e03db036
---
title: Text manipulation
title: Batch processing
author: "Laurent Modolo"
output:
rmdformats::downcute:
self_contain: false
use_bookdown: true
default_style: "light"
lightbox: true
css: "./www/style_Rmd.css"
---
```{r include = FALSE}
if (!require("fontawesome")) {
install.packages("fontawesome")
}
if (!require("klippy")) {
install.packages("remotes")
remotes::install_github("rlesur/klippy")
}
library(fontawesome)
knitr::opts_chunk$set(echo = TRUE)
knitr::opts_chunk$set(comment = NA)
klippy::klippy(
position = c('top', 'right'),
color = "white",
tooltip_message = 'Click to copy',
tooltip_success = 'Copied !')
```
## Batch processing
[![cc_by_sa](./img/cc_by_sa.png)](http://creativecommons.org/licenses/by-sa/4.0/)
<a rel="license" href="http://creativecommons.org/licenses/by-sa/4.0/">
<img alt="Creative Commons License" style="border-width:0" src="https://i.creativecommons.org/l/by-sa/4.0/88x31.png" />
</a>
Objective: Learn basics of batch processing in GNU/Linux
......@@ -57,9 +40,9 @@ You can also use the `||` to manage errors and run `CMD2` if `CMD1` failed.
CMD1 || CMD2
```
### Executing list of commands
## Executing list of commands
The easiest option to execute list of command is to use `xargs`. `xargs` reads arguments from **stdin** and use them as argument for a command. In UNIX systems the command `echo` send string of character into **stdout**. We are going to use this command to learn more about `xargs`.
The easiest option to execute list of command is to use `xargs`. `xargs` reads arguments from **stdin** and use them as arguments for a command. In UNIX systems the command `echo` send string of character into **stdout**. We are going to use this command to learn more about `xargs`.
```sh
echo "hello world"
......@@ -138,7 +121,7 @@ find /tmp/ -type d | xargs -t rm -R
</p>
</details>
### Writing `awk` commands
## Writing `awk` commands
`xargs` It is a simple solution for writing batch commands, but if you want to write more complex command you are going to need to learn `awk`. `awk` is a programming language by itself, but you don’t need to know everything about `awk` to use it.
......@@ -149,7 +132,7 @@ There are also some predefined variables that you can use like.
- `$0` Correspond to all the columns.
- `FS` the field separator used
- `NF` the number of fields separated by `FS`
- `NR` the number for records already read
- `NR` the number of records already read
A `awk` program is a chain of commands with the form `motif { action }`
......@@ -240,7 +223,7 @@ awk 'BEGIN {OFS = "\n"} {header = $0 ; getline seq ; getline qheader ; getline q
### Writing a bash script
## Writing a bash script
When you start writing complicated command, you may want to save them to reuse them later.
......@@ -269,7 +252,7 @@ echo "download and extraction complete"
</details>
#### shebang
### shebang
In your first bash script, the only thing saying that your script is a bash script is its extension. But most of the time UNIX system doesn’t care about file extension, a text file is a text file.
......@@ -306,7 +289,7 @@ Now you can execute your script with the command:
Congratulations you wrote your first program !
#### PATH
### PATH
Where did they `/usr/bin/env` find the information about your bash ? Why did we have to write a `./` before our script if we are in the same folder ?
......@@ -378,7 +361,7 @@ You can check the result of your command with `echo $PATH`
Try to call your `download_hg38.sh` from anywhere on the file tree. Congratulation you installed your first UNIX program !
#### Arguments
### Arguments
You can pass argument to your bash scripts, writing the following command:
......@@ -399,7 +382,7 @@ Means that from within the script:
You can write the following `variables.sh` script in your `scripts` folder:
```sh
#!/bin/bash
##!/bin/bash
echo "Name of the script: $0"
echo "Total number of arguments: $#"
......@@ -408,7 +391,6 @@ echo "Values of all the arguments: $@"
And you can try to call it with some arguments !
In the next session, we are going to learn how to execute command on other computers with [ssh.](./10_network_and_ssh.html)
> We have used the following commands:
>
......@@ -420,3 +402,5 @@ In the next session, we are going to learn how to execute command on other compu
> - `shebang` to specify the language of a script
> - `PATH` to install script
In the next session, we are going to learn how to execute command on other computers with [ssh.](./10_network_and_ssh.html)
_quarto.yml 0 → 100644
View file @ e03db036
project:
type: book
book:
title: "UNIX command line"
author:
- "Laurent Modolo"
date: "2023-10-09"
chapters:
- index.md
- 1_understanding_a_computer.Rmd
- 2_using_the_ifb_cloud.Rmd
- 3_first_steps_in_a_terminal.Rmd
- 4_unix_file_system.Rmd
- 5_users_and_rights.Rmd
- 6_unix_processes.Rmd
- 7_streams_and_pipes.Rmd
- 8_text_manipulation.Rmd
- 9_batch_processing.Rmd
- 10_network_and_ssh.Rmd
- 11_install_system_programs.Rmd
- 12_virtualization.Rmd
body-footer: "License: Creative Commons [CC-BY-SA-4.0](http://creativecommons.org/licenses/by-sa/4.0/).<br>Made with [Quarto](https://quarto.org/)."
navbar:
search: true
right:
- icon: git
href: https://gitbio.ens-lyon.fr/can/unix-command-line
text: Sources
# bibliography: references.bib
format:
html:
theme:
light: flatly
dark: darkly
execute:
cache: true
\ No newline at end of file
index.md
View file @ e03db036
---
title: # Unix / command line training course
---
# Unix / command line training course
## Unix / command line training course {.unnumbered}
1. [Understanding a computer](./1_understanding_a_computer.html)
2. [Using the IFB cloud](./2_using_the_ifb_cloud.html)
......
orga/ifb_cloud_group_desc.md 0 → 100644
View file @ e03db036
# IFB cloud group description for UNIX training
## Short name
CAN UNIX 2023
## Full name
UNIX command line training
## Website
https://gitbio.ens-lyon.fr/can/unix-command-line/
---
# Detailed description
## Résumé (20 lignes)
Le [Conseil d'Analyse Numérique (CAN)](https://www.sfr-biosciences.fr/la-sfr/conseil-analyse-numerique/) de l'UAR [SFR BioSciences](https://www.sfr-biosciences.fr) (Lyon) organise une formation **"UNIX ligne de commandes"** à destination des membres des laboratoires de biologie affiliés (entre autres ceux hébergés à l'ENS de Lyon), laquelle débutera début octobre.
Cette formation s'étalera sur une quatorzaine de semaines à raison de 1h30 par semaine au semestre d'automne (suivant les demandes, elle aura lieu tous les ans au semestre d'automne).
Les objectifs de cette formation sont:
- comprendre le fonctionnement général d'un ordinateur
- interagir avec un système de type UNIX par une interface en ligne de commande
- utiliser des ressources distantes en ligne de commande
- installer et utiliser des programmes en ligne de commandes
- manipuler des données de types textuelles de manière automatisée
- avoir des notions d'administration sur ce type de système
- avoir des notions en virtualisation de système
## Informations pratiques
- Dates : 1h30/semaine de octobre 2022 à janvier 2023
- Lieu : Centre Blaise Pascal (CBP), ENS de Lyon
- Noms des formateurs : Laurent Modolo, Ghislain Durif, Mia Croiset
- Nombre de participants : 12
## Ressources demandées
Nous utiliserons des instances de l'*appliance* "LBMC Unix 2022" déjà utilisée l'année dernière. Les TPs portent sur la prise en main de commandes bash, donc les VM les plus petites suffisent, pour un TP d'1h30 nous aurons besoin de 2 vCPU par VM au plus.
### Outils et environnements
- une distribution Linux standard (Ubuntu)
- docker
- bash
- shellinabox (pour un accès au terminal via une interface web)
Tous ces outils sont intégrés dans l'*appliance* "LBMC Unix 2022".
### Resources informatiques
*Indiquer la quantité estimée de calcul et de stockage sur la durée totale de votre formation.*
* Taille max des VMs par participant : 2 vCPU, 2Go mémoire RAM, gabarit `ifb.tr.medium` (2c 2Go)
* Nombre total d'heures vCPU (vCPU.h) : 2 vCPU * (12 participants + 2 encadrants) * 14 séances * 1h30 = 588 vCPU.h
* Volume de stockage partagé : <1Go
* Besoins spécifiques
- grosse mémoire (RAM > 1 To) : NON
- GPU : NON
- haute fréquence processeur (> 3 GHz) : NON
- parallélisme : 2 vCPU/VM max
Disponibilité des ressources après la formation ? NON
---
## Start
10/10/2023
## End
31/01/2023
orga/mail_call_trainer.txt 0 → 100644
View file @ e03db036
# Appel à formateurs/formatrices pour formations "UNIX ligne de commandes" et "R pour les débutant(e)s", automne 2024
Bonjour (english below)
---
TL;DR appel à formateurs/formatrices pour des formations hebdomadaire au semestre d'automne "UNIX ligne de commandes" (1 créneau) et "R pour les débutant(e)s" (4 créneaux), liens pour s'inscrire ci-dessous
---
Le CAN (https://www.sfr-biosciences.fr/la-sfr/conseil-analyse-numerique/) va organiser deux formations sur le semestre d'automne qui débuteront débuts octobre : "UNIX ligne de commandes" et "R pour les débutant(e)s". En option, une extension à Python d'une partie du contenu de la formation "R pour les débutant(e)s" sera proposée sur deux séances supplémentaires.
Ces formations s'étaleront sur une dizaine de semaines, jusqu'en décembre (sauf pendant les vacances de Toussaint et Noël, avec la possibilité de rajouter quelques séances en janvier si besoin) à raison de 1h30 de travaux pratiques par semaine avec 10 personnes par créneau.
Ces formations sont accessibles à tous les membres (permanents et non permanents) des laboratoires suivants (partenaires de la SFR BioSciences) : CIRI, IGFL, LBMC, RDP, MMSB, LBTI, IVPC, IBCP.
Afin d'animer ces formations, nous sommes à la recherche de formateurs et formatrices volontaires, idéalement au moins 2 par créneau.
Informations importantes :
- il n'y a pas de préparation, les supports sont prêts,
- c'est 1h30 par semaine, on peut facilement échanger si un jour on n'est pas dispo,
- les personnes formées sont vraiment débutantes donc les questions ne seront pas complexes et toute aide sera la bienvenue, il faut juste être à l'aise avec R ou avec la ligne de commande sur UNIX (e.g. OS Linux), pas besoin d'être un expert ou une experte,
- et surtout c'est super enrichissant!
Si vous êtes intéressé(e), vous pouvez vous inscrire via les liens suivants :
- UNIX ligne de commandes : https://framaforms.org/appel-a-formatrices-et-formateurs-pour-la-formation-unix-ligne-de-commande-call-for-trainers-for-0
- R pour les débutant(e)s : https://framaforms.org/appel-a-formatrices-et-formateurs-pour-la-formation-r-pour-les-debutantes-call-for-trainers-for-r-0
Planning :
- lundi 13h-14h30 : R pour les débutant(e)s
- mardi 11h-12h30 : UNIX ligne de commandes
- mercredi 11h-12h30 : R pour les débutant(e)s
- jeudi 11h-12h30 : R pour les débutant(e)s (in ENGLISH)
- vendredi 11h-12h30 : R pour les débutant(e)s
Si vous avez des questions, vous pouvez contacter:
- Laurent Gilquin (laurent.gilquin@ens-lyon.fr)
Merci d'avance,
Bien cordialement,
----
# Call for trainers for "R for beginners" and "UNIX command line" training sessions, fall 2024
Hi,
---
TL;DR call for trainers for the weekly training session during fall semester : "UNIX command line" (1 slot) and "R for beginners" (4 slots), link to register below
---
The CAN (https://www.sfr-biosciences.fr/la-sfr/conseil-analyse-numerique/) will organize two training session during the fall semester (starting in early October): "UNIX command line" and "R for beginners". As an option, an extension to Python of the "R for beginners" course will be proposed over two additional sessions.
These training sessions will take place during around ten weeks, until December (except during Toussaint and Christmas Holidays, with the possibility to add additional slots in January if necessary), with 1h30 of tutorial/practical every week and 10 trainees/slot.
These training sessions are available for all (permanent and non-permanent) members of the following labs (SFR BioSciences partners): CIRI, IGFL, LBMC, RDP, MMSB, LBTI, IVPC, IBCP.
We are looking for volunteers to be trainers, ideally 2 per slot.
Important information :
- no preparation required, training materials are ready,
- it is only 1h30 per week (or more if you want to teach multiple sessions), it is possible to switch spots with other trainers if you are not available one time,
- trainees will be beginners, so questions will not be too complex and any help is welcomed, you just need to be a regular UNIX command line user (e.g. Linux OS) or R user, no need to be an expert,
- and also it is highly rewarding!
If you are interested, please register using the following links :
- UNIX command line: https://framaforms.org/appel-a-formatrices-et-formateurs-pour-la-formation-unix-ligne-de-commande-call-for-trainers-for-0
- R for beginners: https://framaforms.org/appel-a-formatrices-et-formateurs-pour-la-formation-r-pour-les-debutantes-call-for-trainers-for-r-0
Schedule :
- Monday 13h-14h30 : R pour les débutant(e)s
- Tuesday 11h-12h30 : UNIX ligne de commandes
- Wednesday 11h-12h30 : R pour les débutant(e)s
- Thursday 11h-12h30 : R pour les débutant(e)s (in ENGLISH)
- Friday 11h-12h30 : R pour les débutant(e)s
If you have any questions, please contact:
- Laurent Gilquin (laurent.gilquin@ens-lyon.fr)
Thanks in advance,
Best regards,
orga/mail_registration.txt 0 → 100644
View file @ e03db036
# Formations "UNIX ligne de commandes" et "R pour les débutant(e)s", automne 2024
Bonjour (english below)
---
TL;DR formations hebdomadaire au semestre d'automne "UNIX ligne de commandes" (10 places sur 1 créneau) et "R pour les débutant(e)s" (40 places sur 4 créneaux), liens pour s'inscrire ci-dessous (merci de bien lire les informations ci-dessous)
---
Le CAN (https://www.sfr-biosciences.fr/la-sfr/conseil-analyse-numerique/) va organiser deux formations sur le semestre d'automne qui débuteront débuts octobre : "UNIX ligne de commandes" et "R pour les débutant(e)s". En option, une extension à Python d'une partie du contenu de la formation "R pour les débutant(e)s" sera proposée sur deux séances supplémentaires.
Ces formations s'étaleront sur une dizaine de semaines, jusqu'en décembre (sauf pendant les vacances de Toussaint et Noël, avec la possibilité de rajouter quelques séances en janvier si besoin) à raison de 1h30 de travaux pratiques par semaine.
Ces formations sont accessibles à tous les membres (permanents et non permanents) des laboratoires suivants (partenaires de la SFR BioSciences): CIRI, IGFL, LBMC, RDP, MMSB, LBTI, IVPC, IBCP.
Prérequis : avoir un compte @ens-lyon.fr (pour accéder aux ordinateurs des salles de TP) ou avoir un ordinateur portable avec accès à internet via eduroam et un navigateur internet récent (aucune installation spécifique nécessaire, les TPs se font via une plateforme spécifique accessible par son navigateur Internet).
Il y aura 1 créneau hebdomadaire (en français ou anglais suivant la demande) pour la formation UNIX (soit 10 places) et 4 créneaux hebdomadaires pour la formation R (soit 40 places au total), dont 1 créneau en anglais.
Si vous êtes intéressé(e), vous pouvez vous inscrire via les liens suivants :
- UNIX ligne de commandes : https://framaforms.org/formation-unix-ligne-de-commande-unix-command-line-training-session-1720512376
- R pour les débutant(e)s : https://framaforms.org/formation-r-pour-les-debutantes-r-for-beginners-training-session-1720512419
IMPORTANT : En vous inscrivant vous vous engagez à venir sur l'ensemble de la formation (sauf absence ponctuelle en cas d'impératif professionnel ou personnel évidemment). Les attestations de formation ne seront délivrées qu'aux personnes ayant suivi au moins 80% des séances de leur groupe.
Planning :
- lundi 13h-14h30 : R pour les débutant(e)s
- mardi 11h-12h30 : UNIX ligne de commandes
- mercredi 11h-12h30 : R pour les débutant(e)s
- jeudi 11h-12h30 : R pour les débutant(e)s (in ENGLISH)
- vendredi 11h-12h30 : R pour les débutant(e)s
Si vous avez des questions, vous pouvez contacter:
- Laurent Gilquin (laurent.gilquin@ens-lyon.fr)
# Note : un e-mail différent sera envoyé pour en appeler aux formateurs et formatrices volontaires
Les objectifs de ces formations sont :
Pour "UNIX ligne de commandes" :
- comprendre le fonctionnement général d'un ordinateur
- interagir avec un système de type UNIX par une interface en ligne de commande
- utiliser des ressources distantes en ligne de commande
- installer et utiliser des programmes en ligne de commandes
- manipuler des données de types textuelles de manière automatisée
- avoir des notions d'administration sur ce type de système
- avoir des notions en virtualisation de système
Pour "R pour les débutant(e)s" :
- apprendre les bases du langages R
- apprendre à utiliser l’IDE Rstudio
- importer des tables de données
- filtrer et trier des tables de données
- réorganiser des tables de données
- réaliser des figures
- manipuler des EXpressions REGulières (regex)
Bien cordialement,
----
# "R for beginners" and "UNIX command line" training sessions, fall 2024
Hi,
---
TL;DR weekly training session during fall semester : "UNIX command line" (10 places on 1 slot) and "R for beginners" (40 places on 4 slots), link to register below (thanks to carefully read the information below)
---
The CAN (https://www.sfr-biosciences.fr/la-sfr/conseil-analyse-numerique/) will organize two training session during the fall semester (starting in early October): "UNIX command line" and "R for beginners". As an option, an extension to Python of the "R for beginners" course will be proposed over two additional sessions.
These training sessions will take place during around ten weeks, until December (except during Toussaint and Christmas Holidays, with the possibility to add additional slots in January if necessary), with 1h30 of tutorial/practical every week.
These training sessions are available for all (permanent and non-permanent) members of the following labs (SFR BioSciences partners): CIRI, IGFL, LBMC, RDP, MMSB, LBTI, IVPC, IBCP.
Requirement: having an @ens-lyon.fr account (to access computers during the session) or having a laptop with a working eduroam Internet access and a recent web browser (no further installation is required, all practicals will be done via a specific platform available through the web browser).
There will be 1 weekly session (in french or in english depending on the registered persons) pour the UNIX training (10 places) and 4 weekly sessions for the R training (40 places), including 1 session in english.
If you are interested, please register using the following links :
- UNIX command line: https://framaforms.org/formation-unix-ligne-de-commande-unix-command-line-training-session-1720512376
- R for beginners: https://framaforms.org/formation-r-pour-les-debutantes-r-for-beginners-training-session-1720512419
IMPORTANT: By registering, you agree to attend the entire course (except for one-time absences in case of professional or personal imperative obviously). Training certificates will only be delivered to people who have attended at least 80% of their group's sessions.
Schedule :
- Monday 13h-14h30 : R pour les débutant(e)s
- Tuesday 11h-12h30 : UNIX ligne de commandes
- Wednesday 11h-12h30 : R pour les débutant(e)s
- Thursday 11h-12h30 : R pour les débutant(e)s (in ENGLISH)
- Friday 11h-12h30 : R pour les débutant(e)s
If you have any questions, please contact:
- Laurent Gilquin (laurent.gilquin@ens-lyon.fr)
# Note: a separate e-mail will be send to call for trainers
The contents of the these training sessions are the following :
For "UNIX command line":
- understand the general functioning of a computer
- interact with a UNIX-type system through the command line interface
- use remote resources through command line
- install and use software and programs through command line
- automatically manipulate text data
- learn basic knowledge of system administration
- learn basic knowledge of system virtualization
For "R for beginners":
- learn basic knowledge of R language programming
- use Rstudio IDE (Integrated Development Environment)
- import data table/array
- filter and sort data table
- reorganize data table
- generate graphics and plots
- manipulate REGular EXpressions (regex)
Best regards,
orga/yakform_call_trainer_unix.txt 0 → 100644
View file @ e03db036
$webform = array (
'nid' => '987106',
'next_serial' => '1',
'confirmation' => '',
'confirmation_format' => 'wysiwyg_user',
'redirect_url' => '<none>',
'status' => '1',
'block' => '0',
'allow_draft' => '0',
'auto_save' => '0',
'submit_notice' => '1',
'confidential' => '0',
'submit_text' => '',
'submit_limit' => '1',
'submit_interval' => '-1',
'total_submit_limit' => '-1',
'total_submit_interval' => '-1',
'progressbar_bar' => '0',
'progressbar_page_number' => '0',
'progressbar_percent' => '0',
'progressbar_pagebreak_labels' => '1',
'progressbar_include_confirmation' => '1',
'progressbar_label_first' => 'Inscription / Registration',
'progressbar_label_confirmation' => 'Terminé',
'preview' => '0',
'preview_next_button_label' => '',
'preview_prev_button_label' => '',
'preview_title' => '',
'preview_message' => '',
'preview_message_format' => 'wysiwyg_user',
'preview_excluded_components' =>
array (
),
'confirm_email_request_lifetime' => NULL,
'confirm_email_delete_submissions' => '0',
'record_exists' => true,
'roles' =>
array (
0 => '1',
1 => '2',
),
'emails' =>
array (
),
'components' =>
array (
15 =>
array (
'nid' => 987106,
'cid' => '15',
'pid' => '0',
'form_key' => 'new_1663580649768',
'name' => 'Prénom / Name',
'type' => 'textfield',
'value' => '',
'extra' =>
array (
'width' => '',
'maxlength' => '',
'minlength' => '',
'field_prefix' => '',
'field_suffix' => '',
'disabled' => 0,
'unique' => 0,
'title_display' => 'before',
'description' => '',
'description_above' => false,
'placeholder' => 'John',
'attributes' =>
array (
),
'private' => 0,
'analysis' => false,
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '1',
'page_num' => 1,
),
14 =>
array (
'nid' => 987106,
'cid' => '14',
'pid' => '0',
'form_key' => 'new_1663580608320',
'name' => 'Nom / Surname',
'type' => 'textfield',
'value' => '',
'extra' =>
array (
'width' => '',
'maxlength' => '',
'minlength' => '',
'field_prefix' => '',
'field_suffix' => '',
'disabled' => 0,
'unique' => 0,
'title_display' => 'before',
'description' => '',
'description_above' => false,
'placeholder' => 'Dupont',
'attributes' =>
array (
),
'private' => 0,
'analysis' => false,
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '2',
'page_num' => 1,
),
1 =>
array (
'nid' => 987106,
'cid' => '1',
'pid' => '0',
'form_key' => 'new_1661852344800',
'name' => 'adresse e-mail / e-mail address',
'type' => 'email',
'value' => '@ens-lyon.fr (ou @inserm.fr, @chu-lyon.fr)',
'extra' =>
array (
'multiple' => 0,
'format' => 'short',
'width' => '',
'unique' => 0,
'disabled' => 0,
'title_display' => 'before',
'description' => '',
'description_above' => false,
'placeholder' => '',
'attributes' =>
array (
),
'private' => 0,
'analysis' => true,
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '3',
'page_num' => 1,
),
3 =>
array (
'nid' => 987106,
'cid' => '3',
'pid' => '0',
'form_key' => 'new_1661852536156',
'name' => 'Laboratoire / Laboratory',
'type' => 'select',
'value' => '',
'extra' =>
array (
'items' => '1|CIRI - Centre International de Recherche en Infectiologie
2|IGFL - Institut de Génomique Fonctionnelle de lyon
3|LBMC - Laboratoire de Biologie et modelisation de la Cellule
RDP - Laboratoire de Reproduction et Développement des Plantes|RDP - Laboratoire de Reproduction et Développement des Plantes
MMSB - MOlecular microbiology and structural biochemistry|MMSB - MOlecular microbiology and structural biochemistry
LBTI - Laboratoire de Biologie Tissulaire et d\'Ingénierie Thérapeutique|LBTI - Laboratoire de Biologie Tissulaire et d\'Ingénierie Thérapeutique
IVPC - Infections Virales et Pathologie Comparée|IVPC - Infections Virales et Pathologie Comparée
IBCP - Institut de Biologie et Chimie des Proteines Unité mixte de service UMS3760 CNRS-UCBL - Directeur : Christophe Geourjon L\'IBCP héberge les 2 unités de recherche MMSB et LBTI. L’institut a pour vocation de gérer le bâtiment, les ressources technologiques et une partie du personnel technique partagé par ces 2 unités.|IBCP - Institut de Biologie et Chimie des Proteines Unité mixte de service UMS3760 CNRS-UCBL - Directeur : Christophe Geourjon L\'IBCP héberge les 2 unités de recherche MMSB et LBTI. L’institut a pour vocation de gérer le bâtiment, les ressources technologiques et une partie du personnel technique partagé par ces 2 unités.
',
'multiple' => false,
'aslist' => true,
'empty_option' => '',
'optrand' => 0,
'other_option' => NULL,
'other_text' => 'Autre...',
'title_display' => 'before',
'description' => '',
'description_above' => false,
'custom_keys' => 0,
'options_source' => '',
'private' => 0,
'analysis' => true,
'value' => '1',
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '4',
'page_num' => 1,
),
30 =>
array (
'nid' => 987106,
'cid' => '30',
'pid' => '0',
'form_key' => 'new_1693394806558',
'name' => 'J\'ai un compte @ens-lyon.fr / I have an @ens-lyon.fr account',
'type' => 'select',
'value' => '',
'extra' =>
array (
'items' => '1|Oui / Yes
2|Non / No
',
'multiple' => false,
'aslist' => false,
'empty_option' => '',
'optrand' => 0,
'other_option' => NULL,
'other_text' => 'Autre...',
'title_display' => 'before',
'description' => '',
'description_above' => false,
'custom_keys' => 0,
'options_source' => '',
'private' => 0,
'analysis' => true,
'value' => '1',
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '5',
'page_num' => 1,
),
31 =>
array (
'nid' => 987106,
'cid' => '31',
'pid' => '0',
'form_key' => 'new_1693394865971',
'name' => 'J\'ai un compte sur le cloud de l\'IFB (Institut Français de Bioinformatique)',
'type' => 'select',
'value' => '',
'extra' =>
array (
'items' => '1|Oui / Yes
2|Non / No
',
'multiple' => false,
'aslist' => false,
'empty_option' => '',
'optrand' => 0,
'other_option' => NULL,
'other_text' => 'Autre...',
'title_display' => 'before',
'description' => '',
'description_above' => false,
'custom_keys' => 0,
'options_source' => '',
'private' => 0,
'analysis' => true,
'value' => '1',
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '6',
'page_num' => 1,
),
32 =>
array (
'nid' => 987106,
'cid' => '32',
'pid' => '0',
'form_key' => 'new_1693394929998',
'name' => 'Cloud IFB',
'type' => 'markup',
'value' => '<p>Nous utilisons le cloud de l\'IFB (<link href="https://biosphere.france-bioinformatique.fr/">https://biosphere.france-bioinformatique.fr/</link>) pour les travaux pratiques (les stagiaires travailleront depuis un navigateur internet sur une machine virtuelle (Ubuntu) hébergée sur le cloud de l\'IFB).</p>
<p><i>We use the IFB cloud (<link href="https://biosphere.france-bioinformatique.fr/">https://biosphere.france-bioinformatique.fr/</link>) for the practicals (trainees work in their web browser on virtual machine (Ubuntu) hosted on IFB cloud).</i></p>',
'extra' =>
array (
'format' => 'wysiwyg_user',
'private' => false,
'display_on' => 'form',
),
'required' => '0',
'weight' => '7',
'page_num' => 1,
),
12 =>
array (
'nid' => 987106,
'cid' => '12',
'pid' => '0',
'form_key' => 'new_1663579980628',
'name' => 'Choix des créneaux de préférences ? / Preferred slots ?',
'type' => 'grid',
'value' => '',
'extra' =>
array (
'options' => '0|Oui, je suis disponible / Yes, I am available
3|Non disponible / Not available
',
'questions' => '1|Mardi / Tuesday 11h-12h30 - salle numérique CBP (ENS de Lyon)
',
'optrand' => 0,
'qrand' => 0,
'unique' => 0,
'title_display' => 'before',
'custom_option_keys' => 0,
'custom_question_keys' => 0,
'sticky' => true,
'description' => '',
'description_above' => false,
'private' => 0,
'analysis' => true,
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '8',
'page_num' => 1,
),
23 =>
array (
'nid' => 987106,
'cid' => '23',
'pid' => '0',
'form_key' => 'new_1693320671454',
'name' => 'Créneaux / Slots',
'type' => 'markup',
'value' => '<p>Les salles seront reprécisées par la suite.</p>
<p><i>More details about the locations will be given later.</i></p>
<p>Il y a 10 stagiaires par créneaux, et idéalement 2 formateurs ou formatrices.</p>
<p><i>There will be 10 trainees per slot, and ideally 2 trainers.</i></p>',
'extra' =>
array (
'format' => 'wysiwyg_user',
'private' => false,
'display_on' => 'form',
),
'required' => '0',
'weight' => '9',
'page_num' => 1,
),
26 =>
array (
'nid' => 987106,
'cid' => '26',
'pid' => '0',
'form_key' => 'new_1693321164081',
'name' => 'Langue souhaitée / Preferred language',
'type' => 'select',
'value' => '',
'extra' =>
array (
'items' => '1|Français
2|English
3|Pas de préférence / No preference
',
'multiple' => false,
'aslist' => false,
'empty_option' => '',
'optrand' => 0,
'other_option' => NULL,
'other_text' => 'Autre...',
'title_display' => 'before',
'description' => '',
'description_above' => false,
'custom_keys' => 0,
'options_source' => '',
'private' => 0,
'analysis' => true,
'value' => '1',
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '10',
'page_num' => 1,
),
21 =>
array (
'nid' => 987106,
'cid' => '21',
'pid' => '0',
'form_key' => 'new_1693319362737',
'name' => 'En vous inscrivant vous vous engagez à animer l\'ensemble de la formation. / By registering, you agree to teach the entire course.',
'type' => 'select',
'value' => '',
'extra' =>
array (
'items' => '1|Oui / Yes
',
'multiple' => true,
'aslist' => false,
'empty_option' => '',
'optrand' => 0,
'other_option' => NULL,
'other_text' => 'Autre...',
'title_display' => 'before',
'description' => '',
'description_above' => false,
'custom_keys' => 0,
'options_source' => '',
'private' => 0,
'analysis' => true,
'value' => '1,2',
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '1',
'weight' => '12',
'page_num' => 1,
),
24 =>
array (
'nid' => 987106,
'cid' => '24',
'pid' => '0',
'form_key' => 'new_1693320727085',
'name' => 'Nouveau champ "balisage"',
'type' => 'markup',
'value' => '<p>(sauf absence ponctuelle en cas d\'impératif professionnel ou personnel évidemment)</p>
<p><i>(except for one-time absences in case of professional or personal imperative obviously)</i><p>',
'extra' =>
array (
'format' => 'wysiwyg_user',
'private' => false,
'display_on' => 'form',
),
'required' => '0',
'weight' => '13',
'page_num' => 1,
),
28 =>
array (
'nid' => 987106,
'cid' => '28',
'pid' => '0',
'form_key' => 'new_1693321289280',
'name' => 'Remarques ou commentaires / Remarks or comments',
'type' => 'textarea',
'value' => '',
'extra' =>
array (
'cols' => '',
'rows' => '',
'title_display' => 'before',
'resizable' => 1,
'disabled' => 0,
'description' => '',
'description_above' => false,
'placeholder' => '',
'attributes' =>
array (
),
'private' => 0,
'analysis' => false,
'css_classes' => '',
'wrapper_classes' => '',
),
'required' => '0',
'weight' => '14',
'page_num' => 1,
),
),
'conditionals' =>
array (
),
);