name: inverse layout: true class: center, middle, inverse --- # Files and directories Finding your way around the disk and the files on it. .footnote[Marek Šuppa<br>Ondrej Jariabka<br>Adrián Matejov] --- layout: false class: center, middle # Why Linux for Data Science?  [The Data Science Venn Diagram](http://drewconway.com/zia/2013/3/26/the-data-science-venn-diagram) --- ## What's on this computer? - `lscpu -e` - display information about available CPU - `-e` makes the output a bit less verbose and a bit more "human readable" -- - `free` - report on how RAM is being used - by default reports the values in [kibibytes](https://en.wikipedia.org/wiki/Kibibyte) (KiB == 1024 B) - normally used as `free -m` (MiB: [mebibytes](https://en.wikipedia.org/wiki/Mebibyte)) - can also report megabytes (1000² bytes) via `free --mega` -- - `top` / `htop` - shows the combined CPU and RAM information in one "graphical" application - also lists the running processes and gives you a quick answer to "what is running on this computer" --- ## What devices are available on this computer? - `lspci` - lists all PCI devices (connected to PCI busses) - `lsusb` - lists all USB ports and devices connected to them - `lsblk` - list all block devices (basically all disks) - `-f` flag makes the output show a bit more about the filesystem (like its type or usage) --- # Block (data) devices Massive variability: - floppy disk - CD / DVD - network disk (Samba, NFS, ...) - hard disk - USB disk (of various types) --- # Disk partitioning - Allows one big disk to be "logically" partitioned to smaller subparts - These partitions are handled as "independed disks" - Allows for specific parts of the filesystem to be dealt with differently - Separate user data from system files - Different filesystem types on different partitions .center[  <br> .font-small[Image from [Wikipedia](https://en.wikipedia.org/wiki/Disk_partitioning#/media/File:GParted_1.0_screenshot.png)] ] --- # What is a file system? - A way of managing 1. where a piece of data starts and finishes on a block device (disk) 2. what its name is (filename), when was it created, ... 3. where can the user find it (what directory does it reside in) 4. on a specific device (i.e. optical discs vs. Flash discs vs. hard discs) -- <br> Standard file system types you are likely to encounter: - **Windows**: FAT32, NTFS, ReFS - **macOS**: APFS - **Linux**: EXT2, EXT3, *EXT4*, XFS, btrfs --- # Folder structure in Linux filesystems - Directories organized in a tree - There is one central "root" directory - It is denoted **`/`** (forward slash) but also called "filesystem root" [](https://mermaid-js.github.io/mermaid-live-editor/#/edit/eyJjb2RlIjoiZ3JhcGggQlRcbiAgICByb290KFwiL1wiKVxuICAgIHJvb3QgLS0-IGJvb3QoXCJib290XCIpXG4gICAgcm9vdCAtLT4gZGV2KFwiZGV2XCIpXG4gICAgcm9vdCAtLT4gbWVkaWEoXCJtZWRpYVwiKVxuICAgIG1lZGlhIC0tPiBjZHJvbVtjZHJvbV1cbiAgICBtZWRpYSAtLT4gdXNiW1wiVVNCXCJdXG4gICAgcm9vdCAtLT4gcHJvYyhcInByb2NcIilcbiAgICByb290IC0tPiBldGMoXCJldGNcIilcbiAgICByb290IC0tPiB1c3IoXCJ1c3JcIilcbiAgICB1c3IgLS0-IHVzcmJpbihcImJpblwiKVxuICAgIHJvb3QgLS0-IGJpbihcImJpblwiKVxuICAgIHJvb3QgLS0-IGhvbWUoXCJob21lXCIpXG4gICAgaG9tZSAtLT4gamFuZShcImphbmVcIilcbiAgICBqYW5lIC0tPiBEb2N1bWVudHNcbiAgICBqYW5lIC0tPiBEb3dubG9hZHNcbiAgICBqYW5lIC0tPiBQaG90b3NcbiAgICBqYW5lIC0tPiBNdXNpY1xuICAgIERvY3VtZW50cyAtLT4gaG9tZXdvcmsoW2hvbWV3b3JrLnR4dF0pXG4gICAgcm9vdCAtLT4gdG1wKFwidG1wXCIpXG4iLCJtZXJtYWlkIjp7InRoZW1lIjoiYmFzZSIsInRoZW1lVmFyaWFibGVzIjp7ImJhY2tncm91bmQiOiIjZjRmNGY0IiwiZGFya01vZGUiOmZhbHNlLCJwcmltYXJ5Q29sb3IiOiIjZmZmNGRkIiwibm90ZUJrZ0NvbG9yIjoiI2ZmZjVhZCIsIm5vdGVUZXh0Q29sb3IiOiIjMzMzIiwiZm9udEZhbWlseSI6IlwidHJlYnVjaGV0IG1zXCIsIHZlcmRhbmEsIGFyaWFsIiwiZm9udFNpemUiOiIxNnB4IiwicHJpbWFyeVRleHRDb2xvciI6IiMzMzMiLCJzZWNvbmRhcnlDb2xvciI6ImhzbCgtNzkuNDExNzY0NzA1OSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwidGVydGlhcnlDb2xvciI6ImhzbCgyMjAuNTg4MjM1Mjk0MSwgMTAwJSwgOTguMzMzMzMzMzMzMyUpIiwicHJpbWFyeUJvcmRlckNvbG9yIjoiaHNsKDQwLjU4ODIzNTI5NDEsIDYwJSwgODMuMzMzMzMzMzMzMyUpIiwic2Vjb25kYXJ5Qm9yZGVyQ29sb3IiOiJoc2woLTc5LjQxMTc2NDcwNTksIDYwJSwgODMuMzMzMzMzMzMzMyUpIiwidGVydGlhcnlCb3JkZXJDb2xvciI6ImhzbCgyMjAuNTg4MjM1Mjk0MSwgNjAlLCA4OC4zMzMzMzMzMzMzJSkiLCJub3RlQm9yZGVyQ29sb3IiOiJoc2woNTIuNjgyOTI2ODI5MywgNjAlLCA3My45MjE1Njg2Mjc1JSkiLCJzZWNvbmRhcnlUZXh0Q29sb3IiOiJyZ2IoMTcuMDAwMDAwMDAwMSwgMTcuMDAwMDAwMDAwMSwgMTcuMDAwMDAwMDAwMSkiLCJ0ZXJ0aWFyeVRleHRDb2xvciI6InJnYig0LjI1MDAwMDAwMDEsIDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxKSIsImxpbmVDb2xvciI6IiMwYjBiMGIiLCJ0ZXh0Q29sb3IiOiIjMzMzIiwibm9kZUJrZyI6IiNmZmY0ZGQiLCJtYWluQmtnIjoiI2ZmZjRkZCIsIm5vZGVCb3JkZXIiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJjbHVzdGVyQmtnIjoiaHNsKDIyMC41ODgyMzUyOTQxLCAxMDAlLCA5OC4zMzMzMzMzMzMzJSkiLCJjbHVzdGVyQm9yZGVyIjoiaHNsKDIyMC41ODgyMzUyOTQxLCA2MCUsIDg4LjMzMzMzMzMzMzMlKSIsImRlZmF1bHRMaW5rQ29sb3IiOiIjMGIwYjBiIiwidGl0bGVDb2xvciI6InJnYig0LjI1MDAwMDAwMDEsIDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxKSIsImVkZ2VMYWJlbEJhY2tncm91bmQiOiJoc2woLTc5LjQxMTc2NDcwNTksIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsIm5vZGVUZXh0Q29sb3IiOiIjMzMzIiwiYWN0b3JCb3JkZXIiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJhY3RvckJrZyI6IiNmZmY0ZGQiLCJhY3RvclRleHRDb2xvciI6IiMzMzMiLCJhY3RvckxpbmVDb2xvciI6ImdyZXkiLCJsYWJlbEJveEJrZ0NvbG9yIjoiI2ZmZjRkZCIsInNpZ25hbENvbG9yIjoiIzMzMyIsInNpZ25hbFRleHRDb2xvciI6IiMzMzMiLCJsYWJlbEJveEJvcmRlckNvbG9yIjoiaHNsKDQwLjU4ODIzNTI5NDEsIDYwJSwgODMuMzMzMzMzMzMzMyUpIiwibGFiZWxUZXh0Q29sb3IiOiIjMzMzIiwibG9vcFRleHRDb2xvciI6IiMzMzMiLCJhY3RpdmF0aW9uQm9yZGVyQ29sb3IiOiJoc2woLTc5LjQxMTc2NDcwNTksIDEwMCUsIDgzLjMzMzMzMzMzMzMlKSIsImFjdGl2YXRpb25Ca2dDb2xvciI6ImhzbCgtNzkuNDExNzY0NzA1OSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwic2VxdWVuY2VOdW1iZXJDb2xvciI6IiNmNGY0ZjQiLCJzZWN0aW9uQmtnQ29sb3IiOiJoc2woMjIwLjU4ODIzNTI5NDEsIDEwMCUsIDk4LjMzMzMzMzMzMzMlKSIsImFsdFNlY3Rpb25Ca2dDb2xvciI6IndoaXRlIiwic2VjdGlvbkJrZ0NvbG9yMiI6IiNmZmY0ZGQiLCJ0YXNrQm9yZGVyQ29sb3IiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJ0YXNrQmtnQ29sb3IiOiIjZmZmNGRkIiwiYWN0aXZlVGFza0JvcmRlckNvbG9yIjoiI2ZmZjRkZCIsImFjdGl2ZVRhc2tCa2dDb2xvciI6ImhzbCg0MC41ODgyMzUyOTQxLCAxMDAlLCAxMDAlKSIsImdyaWRDb2xvciI6ImxpZ2h0Z3JleSIsImRvbmVUYXNrQmtnQ29sb3IiOiJsaWdodGdyZXkiLCJkb25lVGFza0JvcmRlckNvbG9yIjoiZ3JleSIsImNyaXRCb3JkZXJDb2xvciI6IiNmZjg4ODgiLCJjcml0QmtnQ29sb3IiOiJyZWQiLCJ0b2RheUxpbmVDb2xvciI6InJlZCIsInRhc2tUZXh0Q29sb3IiOiIjMzMzIiwidGFza1RleHRPdXRzaWRlQ29sb3IiOiIjMzMzIiwidGFza1RleHRMaWdodENvbG9yIjoiIzMzMyIsInRhc2tUZXh0RGFya0NvbG9yIjoiIzMzMyIsInRhc2tUZXh0Q2xpY2thYmxlQ29sb3IiOiIjMDAzMTYzIiwibGFiZWxDb2xvciI6IiMzMzMiLCJhbHRCYWNrZ3JvdW5kIjoiaHNsKDIyMC41ODgyMzUyOTQxLCAxMDAlLCA5OC4zMzMzMzMzMzMzJSkiLCJlcnJvckJrZ0NvbG9yIjoiaHNsKDIyMC41ODgyMzUyOTQxLCAxMDAlLCA5OC4zMzMzMzMzMzMzJSkiLCJlcnJvclRleHRDb2xvciI6InJnYig0LjI1MDAwMDAwMDEsIDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxKSIsImNsYXNzVGV4dCI6IiMzMzMiLCJmaWxsVHlwZTAiOiIjZmZmNGRkIiwiZmlsbFR5cGUxIjoiaHNsKC03OS40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJmaWxsVHlwZTIiOiJoc2woMTA0LjU4ODIzNTI5NDEsIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsImZpbGxUeXBlMyI6ImhzbCgtMTUuNDExNzY0NzA1OSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwiZmlsbFR5cGU0IjoiaHNsKC0yMy40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJmaWxsVHlwZTUiOiJoc2woLTE0My40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJmaWxsVHlwZTYiOiJoc2woMTY4LjU4ODIzNTI5NDEsIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsImZpbGxUeXBlNyI6ImhzbCg0OC41ODgyMzUyOTQxLCAxMDAlLCA5My4zMzMzMzMzMzMzJSkifX0sInVwZGF0ZUVkaXRvciI6ZmFsc2V9) --- # Folder structure in Linux filesystems - All the other (non-root) "data devices" are connected in so called "mountpoints" - Normally an empty directory - Once the device is *mounted*, the directory contains its contents - This is in contrast to "disks" (separate partitions) on Windows (with names like `C:\`, `D:\` and so on) [](https://mermaid-js.github.io/mermaid-live-editor/#/edit/eyJjb2RlIjoiZ3JhcGggVEJcbiAgICByb290KFwiL1wiKVxuICAgIHJvb3QgLS0-IGJvb3QoXCJib290XCIpXG4gICAgcm9vdCAtLT4gZGV2KFwiZGV2XCIpXG4gICAgcm9vdCAtLT4gbWVkaWEoXCJtZWRpYVwiKVxuICAgIG1lZGlhIC0tPiBjZHJvbVtjZHJvbV1cbiAgICBtZWRpYSAtLT4gdXNiW1wiVVNCXCJdXG4gICAgcm9vdCAtLT4gcHJvYyhcInByb2NcIilcbiAgICByb290IC0tPiBldGMoXCJldGNcIilcbiAgICByb290IC0tPiB1c3IoXCJ1c3JcIilcbiAgICB1c3IgLS0-IHVzcmJpbihcImJpblwiKVxuICAgIHJvb3QgLS0-IGJpbihcImJpblwiKVxuICAgIHJvb3QgLS0-IGhvbWUoXCJob21lXCIpXG4gICAgaG9tZSAtLT4gamFuZShcImphbmVcIilcbiAgICBqYW5lIC0tPiBEb2N1bWVudHNcbiAgICBqYW5lIC0tPiBEb3dubG9hZHNcbiAgICBqYW5lIC0tPiBQaG90b3NcbiAgICBqYW5lIC0tPiBNdXNpY1xuICAgIERvY3VtZW50cyAtLT4gaG9tZXdvcmsoW2hvbWV3b3JrLnR4dF0pXG4gICAgcm9vdCAtLT4gdG1wKFwidG1wXCIpXG4gICAgc3ViZ3JhcGggbW91bnRwb2ludHNcbiAgICBjZHJvbVxuICAgIHVzYlxuICAgIGVuZCIsIm1lcm1haWQiOnsidGhlbWUiOiJiYXNlIiwidGhlbWVWYXJpYWJsZXMiOnsiYmFja2dyb3VuZCI6IiNmNGY0ZjQiLCJkYXJrTW9kZSI6ZmFsc2UsInByaW1hcnlDb2xvciI6IiNmZmY0ZGQiLCJub3RlQmtnQ29sb3IiOiIjZmZmNWFkIiwibm90ZVRleHRDb2xvciI6IiMzMzMiLCJmb250RmFtaWx5IjoiXCJ0cmVidWNoZXQgbXNcIiwgdmVyZGFuYSwgYXJpYWwiLCJmb250U2l6ZSI6IjE2cHgiLCJwcmltYXJ5VGV4dENvbG9yIjoiIzMzMyIsInNlY29uZGFyeUNvbG9yIjoiaHNsKC03OS40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJ0ZXJ0aWFyeUNvbG9yIjoiaHNsKDIyMC41ODgyMzUyOTQxLCAxMDAlLCA5OC4zMzMzMzMzMzMzJSkiLCJwcmltYXJ5Qm9yZGVyQ29sb3IiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJzZWNvbmRhcnlCb3JkZXJDb2xvciI6ImhzbCgtNzkuNDExNzY0NzA1OSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJ0ZXJ0aWFyeUJvcmRlckNvbG9yIjoiaHNsKDIyMC41ODgyMzUyOTQxLCA2MCUsIDg4LjMzMzMzMzMzMzMlKSIsIm5vdGVCb3JkZXJDb2xvciI6ImhzbCg1Mi42ODI5MjY4MjkzLCA2MCUsIDczLjkyMTU2ODYyNzUlKSIsInNlY29uZGFyeVRleHRDb2xvciI6InJnYigxNy4wMDAwMDAwMDAxLCAxNy4wMDAwMDAwMDAxLCAxNy4wMDAwMDAwMDAxKSIsInRlcnRpYXJ5VGV4dENvbG9yIjoicmdiKDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxLCA0LjI1MDAwMDAwMDEpIiwibGluZUNvbG9yIjoiIzBiMGIwYiIsInRleHRDb2xvciI6IiMzMzMiLCJub2RlQmtnIjoiI2ZmZjRkZCIsIm1haW5Ca2ciOiIjZmZmNGRkIiwibm9kZUJvcmRlciI6ImhzbCg0MC41ODgyMzUyOTQxLCA2MCUsIDgzLjMzMzMzMzMzMzMlKSIsImNsdXN0ZXJCa2ciOiJoc2woMjIwLjU4ODIzNTI5NDEsIDEwMCUsIDk4LjMzMzMzMzMzMzMlKSIsImNsdXN0ZXJCb3JkZXIiOiJoc2woMjIwLjU4ODIzNTI5NDEsIDYwJSwgODguMzMzMzMzMzMzMyUpIiwiZGVmYXVsdExpbmtDb2xvciI6IiMwYjBiMGIiLCJ0aXRsZUNvbG9yIjoicmdiKDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxLCA0LjI1MDAwMDAwMDEpIiwiZWRnZUxhYmVsQmFja2dyb3VuZCI6ImhzbCgtNzkuNDExNzY0NzA1OSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwibm9kZVRleHRDb2xvciI6IiMzMzMiLCJhY3RvckJvcmRlciI6ImhzbCg0MC41ODgyMzUyOTQxLCA2MCUsIDgzLjMzMzMzMzMzMzMlKSIsImFjdG9yQmtnIjoiI2ZmZjRkZCIsImFjdG9yVGV4dENvbG9yIjoiIzMzMyIsImFjdG9yTGluZUNvbG9yIjoiZ3JleSIsImxhYmVsQm94QmtnQ29sb3IiOiIjZmZmNGRkIiwic2lnbmFsQ29sb3IiOiIjMzMzIiwic2lnbmFsVGV4dENvbG9yIjoiIzMzMyIsImxhYmVsQm94Qm9yZGVyQ29sb3IiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJsYWJlbFRleHRDb2xvciI6IiMzMzMiLCJsb29wVGV4dENvbG9yIjoiIzMzMyIsImFjdGl2YXRpb25Cb3JkZXJDb2xvciI6ImhzbCgtNzkuNDExNzY0NzA1OSwgMTAwJSwgODMuMzMzMzMzMzMzMyUpIiwiYWN0aXZhdGlvbkJrZ0NvbG9yIjoiaHNsKC03OS40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJzZXF1ZW5jZU51bWJlckNvbG9yIjoiI2Y0ZjRmNCIsInNlY3Rpb25Ca2dDb2xvciI6ImhzbCgyMjAuNTg4MjM1Mjk0MSwgMTAwJSwgOTguMzMzMzMzMzMzMyUpIiwiYWx0U2VjdGlvbkJrZ0NvbG9yIjoid2hpdGUiLCJzZWN0aW9uQmtnQ29sb3IyIjoiI2ZmZjRkZCIsInRhc2tCb3JkZXJDb2xvciI6ImhzbCg0MC41ODgyMzUyOTQxLCA2MCUsIDgzLjMzMzMzMzMzMzMlKSIsInRhc2tCa2dDb2xvciI6IiNmZmY0ZGQiLCJhY3RpdmVUYXNrQm9yZGVyQ29sb3IiOiIjZmZmNGRkIiwiYWN0aXZlVGFza0JrZ0NvbG9yIjoiaHNsKDQwLjU4ODIzNTI5NDEsIDEwMCUsIDEwMCUpIiwiZ3JpZENvbG9yIjoibGlnaHRncmV5IiwiZG9uZVRhc2tCa2dDb2xvciI6ImxpZ2h0Z3JleSIsImRvbmVUYXNrQm9yZGVyQ29sb3IiOiJncmV5IiwiY3JpdEJvcmRlckNvbG9yIjoiI2ZmODg4OCIsImNyaXRCa2dDb2xvciI6InJlZCIsInRvZGF5TGluZUNvbG9yIjoicmVkIiwidGFza1RleHRDb2xvciI6IiMzMzMiLCJ0YXNrVGV4dE91dHNpZGVDb2xvciI6IiMzMzMiLCJ0YXNrVGV4dExpZ2h0Q29sb3IiOiIjMzMzIiwidGFza1RleHREYXJrQ29sb3IiOiIjMzMzIiwidGFza1RleHRDbGlja2FibGVDb2xvciI6IiMwMDMxNjMiLCJsYWJlbENvbG9yIjoiIzMzMyIsImFsdEJhY2tncm91bmQiOiJoc2woMjIwLjU4ODIzNTI5NDEsIDEwMCUsIDk4LjMzMzMzMzMzMzMlKSIsImVycm9yQmtnQ29sb3IiOiJoc2woMjIwLjU4ODIzNTI5NDEsIDEwMCUsIDk4LjMzMzMzMzMzMzMlKSIsImVycm9yVGV4dENvbG9yIjoicmdiKDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxLCA0LjI1MDAwMDAwMDEpIiwiY2xhc3NUZXh0IjoiIzMzMyIsImZpbGxUeXBlMCI6IiNmZmY0ZGQiLCJmaWxsVHlwZTEiOiJoc2woLTc5LjQxMTc2NDcwNTksIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsImZpbGxUeXBlMiI6ImhzbCgxMDQuNTg4MjM1Mjk0MSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwiZmlsbFR5cGUzIjoiaHNsKC0xNS40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJmaWxsVHlwZTQiOiJoc2woLTIzLjQxMTc2NDcwNTksIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsImZpbGxUeXBlNSI6ImhzbCgtMTQzLjQxMTc2NDcwNTksIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsImZpbGxUeXBlNiI6ImhzbCgxNjguNTg4MjM1Mjk0MSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwiZmlsbFR5cGU3IjoiaHNsKDQ4LjU4ODIzNTI5NDEsIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSJ9fSwidXBkYXRlRWRpdG9yIjpmYWxzZX0) --- # Folder structure in Linux filesystems - Folders are also separated by forward slash (**`/`**) - For instance `/home/jane/Documents/homework.txt` - Note that Windows uses the other slash: backslash (**`\`**) [](https://mermaid-js.github.io/mermaid-live-editor/#/edit/eyJjb2RlIjoiZ3JhcGggVERcbiAgICByb290KFwiL1wiKVxuICAgIHJvb3QgLS0-IGJvb3QoXCJib290XCIpXG4gICAgcm9vdCAtLT4gZGV2KFwiZGV2XCIpXG4gICAgcm9vdCAtLT4gbWVkaWEoXCJtZWRpYVwiKVxuICAgIG1lZGlhIC0tPiBjZHJvbVtjZHJvbV1cbiAgICBtZWRpYSAtLT4gdXNiW1wiVVNCXCJdXG4gICAgcm9vdCAtLT4gcHJvYyhcInByb2NcIilcbiAgICByb290IC0tPiBldGMoXCJldGNcIilcbiAgICByb290IC0tPiB1c3IoXCJ1c3JcIilcbiAgICB1c3IgLS0-IHVzcmJpbihcImJpblwiKVxuICAgIHJvb3QgLS0-IGJpbihcImJpblwiKVxuICAgIHJvb3QgLS0-IGhvbWUoXCJob21lXCIpXG4gICAgaG9tZSAtLT4gamFuZShcImphbmVcIilcbiAgICBqYW5lIC0tPiBEb2N1bWVudHNcbiAgICBqYW5lIC0tPiBEb3dubG9hZHNcbiAgICBqYW5lIC0tPiBQaG90b3NcbiAgICBqYW5lIC0tPiBNdXNpY1xuICAgIERvY3VtZW50cyAtLT4gaG9tZXdvcmsoW2hvbWV3b3JrLnR4dF0pXG4gICAgcm9vdCAtLT4gdG1wKFwidG1wXCIpXG4iLCJtZXJtYWlkIjp7InRoZW1lIjoiYmFzZSIsInRoZW1lVmFyaWFibGVzIjp7ImJhY2tncm91bmQiOiIjZjRmNGY0IiwiZGFya01vZGUiOmZhbHNlLCJwcmltYXJ5Q29sb3IiOiIjZmZmNGRkIiwibm90ZUJrZ0NvbG9yIjoiI2ZmZjVhZCIsIm5vdGVUZXh0Q29sb3IiOiIjMzMzIiwiZm9udEZhbWlseSI6IlwidHJlYnVjaGV0IG1zXCIsIHZlcmRhbmEsIGFyaWFsIiwiZm9udFNpemUiOiIxNnB4IiwicHJpbWFyeVRleHRDb2xvciI6IiMzMzMiLCJzZWNvbmRhcnlDb2xvciI6ImhzbCgtNzkuNDExNzY0NzA1OSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwidGVydGlhcnlDb2xvciI6ImhzbCgyMjAuNTg4MjM1Mjk0MSwgMTAwJSwgOTguMzMzMzMzMzMzMyUpIiwicHJpbWFyeUJvcmRlckNvbG9yIjoiaHNsKDQwLjU4ODIzNTI5NDEsIDYwJSwgODMuMzMzMzMzMzMzMyUpIiwic2Vjb25kYXJ5Qm9yZGVyQ29sb3IiOiJoc2woLTc5LjQxMTc2NDcwNTksIDYwJSwgODMuMzMzMzMzMzMzMyUpIiwidGVydGlhcnlCb3JkZXJDb2xvciI6ImhzbCgyMjAuNTg4MjM1Mjk0MSwgNjAlLCA4OC4zMzMzMzMzMzMzJSkiLCJub3RlQm9yZGVyQ29sb3IiOiJoc2woNTIuNjgyOTI2ODI5MywgNjAlLCA3My45MjE1Njg2Mjc1JSkiLCJzZWNvbmRhcnlUZXh0Q29sb3IiOiJyZ2IoMTcuMDAwMDAwMDAwMSwgMTcuMDAwMDAwMDAwMSwgMTcuMDAwMDAwMDAwMSkiLCJ0ZXJ0aWFyeVRleHRDb2xvciI6InJnYig0LjI1MDAwMDAwMDEsIDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxKSIsImxpbmVDb2xvciI6IiMwYjBiMGIiLCJ0ZXh0Q29sb3IiOiIjMzMzIiwibm9kZUJrZyI6IiNmZmY0ZGQiLCJtYWluQmtnIjoiI2ZmZjRkZCIsIm5vZGVCb3JkZXIiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJjbHVzdGVyQmtnIjoiaHNsKDIyMC41ODgyMzUyOTQxLCAxMDAlLCA5OC4zMzMzMzMzMzMzJSkiLCJjbHVzdGVyQm9yZGVyIjoiaHNsKDIyMC41ODgyMzUyOTQxLCA2MCUsIDg4LjMzMzMzMzMzMzMlKSIsImRlZmF1bHRMaW5rQ29sb3IiOiIjMGIwYjBiIiwidGl0bGVDb2xvciI6InJnYig0LjI1MDAwMDAwMDEsIDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxKSIsImVkZ2VMYWJlbEJhY2tncm91bmQiOiJoc2woLTc5LjQxMTc2NDcwNTksIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsIm5vZGVUZXh0Q29sb3IiOiIjMzMzIiwiYWN0b3JCb3JkZXIiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJhY3RvckJrZyI6IiNmZmY0ZGQiLCJhY3RvclRleHRDb2xvciI6IiMzMzMiLCJhY3RvckxpbmVDb2xvciI6ImdyZXkiLCJsYWJlbEJveEJrZ0NvbG9yIjoiI2ZmZjRkZCIsInNpZ25hbENvbG9yIjoiIzMzMyIsInNpZ25hbFRleHRDb2xvciI6IiMzMzMiLCJsYWJlbEJveEJvcmRlckNvbG9yIjoiaHNsKDQwLjU4ODIzNTI5NDEsIDYwJSwgODMuMzMzMzMzMzMzMyUpIiwibGFiZWxUZXh0Q29sb3IiOiIjMzMzIiwibG9vcFRleHRDb2xvciI6IiMzMzMiLCJhY3RpdmF0aW9uQm9yZGVyQ29sb3IiOiJoc2woLTc5LjQxMTc2NDcwNTksIDEwMCUsIDgzLjMzMzMzMzMzMzMlKSIsImFjdGl2YXRpb25Ca2dDb2xvciI6ImhzbCgtNzkuNDExNzY0NzA1OSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwic2VxdWVuY2VOdW1iZXJDb2xvciI6IiNmNGY0ZjQiLCJzZWN0aW9uQmtnQ29sb3IiOiJoc2woMjIwLjU4ODIzNTI5NDEsIDEwMCUsIDk4LjMzMzMzMzMzMzMlKSIsImFsdFNlY3Rpb25Ca2dDb2xvciI6IndoaXRlIiwic2VjdGlvbkJrZ0NvbG9yMiI6IiNmZmY0ZGQiLCJ0YXNrQm9yZGVyQ29sb3IiOiJoc2woNDAuNTg4MjM1Mjk0MSwgNjAlLCA4My4zMzMzMzMzMzMzJSkiLCJ0YXNrQmtnQ29sb3IiOiIjZmZmNGRkIiwiYWN0aXZlVGFza0JvcmRlckNvbG9yIjoiI2ZmZjRkZCIsImFjdGl2ZVRhc2tCa2dDb2xvciI6ImhzbCg0MC41ODgyMzUyOTQxLCAxMDAlLCAxMDAlKSIsImdyaWRDb2xvciI6ImxpZ2h0Z3JleSIsImRvbmVUYXNrQmtnQ29sb3IiOiJsaWdodGdyZXkiLCJkb25lVGFza0JvcmRlckNvbG9yIjoiZ3JleSIsImNyaXRCb3JkZXJDb2xvciI6IiNmZjg4ODgiLCJjcml0QmtnQ29sb3IiOiJyZWQiLCJ0b2RheUxpbmVDb2xvciI6InJlZCIsInRhc2tUZXh0Q29sb3IiOiIjMzMzIiwidGFza1RleHRPdXRzaWRlQ29sb3IiOiIjMzMzIiwidGFza1RleHRMaWdodENvbG9yIjoiIzMzMyIsInRhc2tUZXh0RGFya0NvbG9yIjoiIzMzMyIsInRhc2tUZXh0Q2xpY2thYmxlQ29sb3IiOiIjMDAzMTYzIiwibGFiZWxDb2xvciI6IiMzMzMiLCJhbHRCYWNrZ3JvdW5kIjoiaHNsKDIyMC41ODgyMzUyOTQxLCAxMDAlLCA5OC4zMzMzMzMzMzMzJSkiLCJlcnJvckJrZ0NvbG9yIjoiaHNsKDIyMC41ODgyMzUyOTQxLCAxMDAlLCA5OC4zMzMzMzMzMzMzJSkiLCJlcnJvclRleHRDb2xvciI6InJnYig0LjI1MDAwMDAwMDEsIDQuMjUwMDAwMDAwMSwgNC4yNTAwMDAwMDAxKSIsImNsYXNzVGV4dCI6IiMzMzMiLCJmaWxsVHlwZTAiOiIjZmZmNGRkIiwiZmlsbFR5cGUxIjoiaHNsKC03OS40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJmaWxsVHlwZTIiOiJoc2woMTA0LjU4ODIzNTI5NDEsIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsImZpbGxUeXBlMyI6ImhzbCgtMTUuNDExNzY0NzA1OSwgMTAwJSwgOTMuMzMzMzMzMzMzMyUpIiwiZmlsbFR5cGU0IjoiaHNsKC0yMy40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJmaWxsVHlwZTUiOiJoc2woLTE0My40MTE3NjQ3MDU5LCAxMDAlLCA5My4zMzMzMzMzMzMzJSkiLCJmaWxsVHlwZTYiOiJoc2woMTY4LjU4ODIzNTI5NDEsIDEwMCUsIDkzLjMzMzMzMzMzMzMlKSIsImZpbGxUeXBlNyI6ImhzbCg0OC41ODgyMzUyOTQxLCAxMDAlLCA5My4zMzMzMzMzMzMzJSkifX0sInVwZGF0ZUVkaXRvciI6ZmFsc2V9) ??? ``` graph TD root("/") root --> boot("boot") root --> dev("dev") root --> media("media") media --> cdrom[cdrom] media --> usb["USB"] root --> proc("proc") root --> etc("etc") root --> usr("usr") usr --> usrbin("bin") root --> bin("bin") root --> home("home") home --> jane("jane") jane --> Documents jane --> Downloads jane --> Photos jane --> Music Documents --> homework([homework.txt]) root --> tmp("tmp") ``` --- # Folder `/home` - The home directories of system's users `/home/jane` - Contains various user data, configuration files, possibly even user's applications -- - Also denoted via the tilda `~` sign (which you see after you log in) -- - Prepended to a username, it indicates that user's home directory - for instance `~jane` would mean `/home/jane` in our example ??? The tilda sign is a nice example of how the realities of where technologies were created shape various decisions we live with even now. Here is what the Wiki says: > This convention derives from the Lear-Siegler ADM-3A terminal in common use during the 1970s, which happened to have the tilde symbol and the word "Home" (for moving the cursor to the upper left) on the same key. https://en.wikipedia.org/wiki/Tilde#Computing --- # Folder `/etc` - From the Latin *et cetera* (and so on) - Configuration of the whole system - Things you can find here: - scripts that are executed on system startup - list of users and their encrypted passwords - network settings - list of available shells - filesystem settings (i.e. where to mount which disk) - ... -- - Basically the nerve centre of the whole system ??? https://www.linux.com/training-tutorials/linux-directory-structure-explainedetc-folder/ https://tldp.org/LDP/sag/html/etc-fs.html --- # Folder `/proc` - Information about the system and the processes running on it in the form of text files - Implemented as a special "virtual filesystem", mounted to the `/proc` folder -- - `/proc/version`: version of the system that's running - `/proc/cpuinfo`: information about CPU - `/proc/meminfo`: information about RAM --- # Folder `/boot` - Files (and directories) necessary for the system boot - Generally contains the kernel and sometimes the temporary filesystem that's being used before the kernel starts up --- # Folders `/bin` and `/usr/bin` - Both contain applications that can be executed from the command line - `/bin` is reserved for system applications (like `who` or `whoami`) - `/usr/bin` contains applications that are not system-critical (like a webbrowser for instance) -- - `/usr` has many more interesting subdirectories; these generally contain files necessary for running the applications installed in `/usr/bin` --- # Folder `/tmp` - Temporary files of the system and its users - These are not expected to "survive a reboot" - On Linux, this generally means that the files will not be written to disk but will stay in RAM ??? Generally implemented via tmpfs -- https://en.wikipedia.org/wiki/Tmpfs --- # Folder `/dev` - As the name suggests, it contains "devices" - These behave as (special) files on the filesystem - There are two types -- - **Character devices** - A stream of characters - `/dev/tty0`, `/dev/input/by-path/platform-thinkpad_acpi-event` - **Block devices** - Provides access to blocks of data (useful for disks) - `/dev/sda1`, `/dev/sda2` -- - Also contains "pseudo devices" - `/dev/null`: accepts and discards all input (basically your own black hole) - `/dev/random`: produces a continuous stream of random data --- # Mounting devices - To attach (mount) a device, we'd run ``` $ mount [device] [folder] ``` so for instance ``` $ mount /dev/sdc /media/MyUSBKey ``` -- - To detach (unmount) a device, we'd run ``` $ umount [folder] ``` so for instance ``` $ umount /media/MyUSBKey ``` -- - Currently mounted devices can be found by running just ``` $ mount ``` --- # Mounting devices: hotplug - Mounting is not necessary in normal usage: things like USB disks are being `mount`ed automatically (hotplug) - Each disk will get its own temporary directory (on Fedora these are in `/run/media/<USER>`, on other distros in `/media`) - After the disk gets detached, the folder disappears (gets removed) -- - Still, before detaching the disk, it is **necessary to run `umount`** to ensure the data is written on it (or at least `sync`) --- template: inverse # Useful commands --- # Useful commands: disks - `df` - reports disk usage - `df -h` - make the report human readable - defaults to powers of 1024, `-H` will give you powers of 1000 - `df --total` - compute the grand total of all available disks as well --- # Useful commands: filesystem navigation - `pwd` - show the path to the current directory - `ls` - list the content of the current directory -- - `cd [directory]` - change the current working directory (where you currently are in the filesystem) to `[directory]` -- - `[directory]` can be both relative and absolute -- ``` cd # go to the home directory cd ~ # go to the home directory cd /home/jane/Documents # go to /home/jane/Documents cd .. # go one level above cd Documents # go to the directory `Documents` in the current folder cd - # go to the previously visited directory ``` --- # Aside: asbolute vs. relative paths - Absolute paths start from the the root (`/`) - For instance `/home/jane/Downloads/homework.pdf` or `/usr/bin/whoami` - No matter where you are on the disk, it will always resolve to the same place - Relative paths **do not** start from the root (`/`) but they are resolved from the current working directory - Special path `.` represents the current directory and `..` the parent directory ``` $ cd /home/joe $ cat Documents/homework.txt This is joe's homework in /home/joe/Documents/homework.txt $ cd /home/jane $ cat ./Documents/homework.txt This is jane's homework in /home/jane/Documents/homework.txt $ cd - # go to the previously visited directory $ pwd /home/joe ``` --- # Aside: hidden files and directories - Files and folders whose name starts with a dot (`.`) are ignored by `ls` - They still exist on the disk but to list them, one needs to use the `-a` or `-A` flag ``` bash $ ls a.txt b.txt c.txt data.dat test.txt $ ls -a . .. a.txt b.txt c.txt data.dat .hidden_file test.txt ``` -- - Note the first two "special paths" in the listing - `.` represents current directory - `..` represents parent directory -- - These can also be chained together ``` $ cd ../../../../ # move four directories higher ``` --- template: inverse # Intermezzo: Bash tips & tricks aka "Don't type more than you need to" --- layout: false # Bash command/path <Tab> expansion *Bash was written by "hackers" for "hackers": efficiency is one of its core tenants* - It is not necessary to type out the full command name or the full path - After `<Tab>` gets pressed, Bash will try to autocomplete the rest of the command or file path -- - If if there are multiple options, it will show them all - You can cycle through them by pressing `<Tab>` (and cycle back with `<Shift-Tab>`) --- # Bash command/path <Tab> expansion - For example: ``` $ lsc<Tab> ``` will become ``` $ lscpu ``` and ``` $ cd Doc<Tab> ``` will become ``` $ cd Documents/ ``` (provided you are a in a directory with a `Documents/` directory in it.) --- # Bash history - The history of all commands you type to Bash are (normally) being saved to `~/.bash_history` - You can get to them by: 1. Pressing the up/down arrow keys 2. Executing the `history` command - To search in the history, start typing a command and then press `Ctrl-r` (and `Shift-Ctrl-r` to cycle through) --- template: inverse # Useful commands (vol. 2) --- # Useful commands: files and directories - `mkdir [directory]` - creates a directory named `[directory]` - `rmdir [directory]` - removes an empty directory `[directory]` (if it's not empty, it'll let you know) -- - `rm [file or directory]` - removes a file or a directory - the `-r` makes `rm` also recursively apply itself on subfolders of its argument ``` $ rm -r /home/jane ``` would remove every file in `/home/jane`, along with any directories and their content --- # Useful commands: files and directories - `cp [source1] [source2] [target]` - copies files and folders from `[source]` to `[target]` - there can be multiple sources - `-r` makes `cp` recursively copy the subfolders as well (it'll tell you otherwise) -- - `mv [source1] [source2] [target]` - moves files and directories from `[source]` to `[target]` - there can be multiple sources --- # Special paths and wildcards - Both `[source]` and `[target]` can be any paths, relative or absolute, even the special ones like `.` and `..` ``` $ cd /home/jane $ cp -r /tmp/tests . # Recursively copies /tmp/tests to /home/jane $ cd /home/joe/Documents $ cp -r /tmp/tests .. # Recursively copies /tmp/tests to /home/joe ``` -- - When working with paths, we can use wildcards like `?` and `*` ```bash $ ls a.txt b.txt c.txt data.dat test.txt $ ls *.txt a.txt b.txt c.txt test.txt $ ls ?.txt a.txt b.txt c.txt ``` -- - In the last example `?.txt` is expanded into all matching objects in the directory (works with [files and directories alike](https://bash.cyberciti.biz/guide/Path_name_expansion)) -- - In other words `ls ?.txt` is equivalent to `ls a.txt b.txt c.txt` --- # Final caveat .center[.red[**There is no undo button here**]] -- > Contrary to popular belief, Unix is user friendly. It just happens to be very selective about who it decides to make friends with. > -- unknown .center[These systems expect you to know what you are doing.] -- .center[ Please use `rm -r` sparingly and with care. ]