Skip to content
Permalink
Branch: master
Commits on May 10, 2019
  1. Anaconda: install version 2019.03 by default.

    riccardomurri committed May 10, 2019
  2. SAMBA: Fix typo in deployed `smb.conf`

    riccardomurri committed May 10, 2019
    Line `name resolve order =` had a typo (`hosts` instead of `host`)
    which however results in an error on SAMBA 4.7.6 (Ubuntu 18.04
    "bionic") and possibly earlier versions.
  3. (Almost) Correctly write variables into Ansible inventory.

    riccardomurri committed May 10, 2019
    Inventory variables with embedded spaces need quoting -- or Ansible
    will not be able to parse the file.  This commit (ab)uses Python's
    `%r` to provide quotes around a value and \-escape any embedded
    quotes; a better fix would definitely be to switch to YAML inventory
    files.
Commits on May 7, 2019
  1. Fail early if `eatmydata` is not installed.

    riccardomurri committed May 7, 2019
Commits on May 6, 2019
  1. Bump version: 1.3.dev12 → 1.3.dev13

    riccardomurri committed May 6, 2019
  2. Use `eatmydata` to speed up installation of SW packages.

    riccardomurri committed May 6, 2019
    Testing on UZH' local OpenStack infrastructure shows that installation
    of Spark+Hadoop goes from 56m to 44m; but even for GridEngine, a full
    minute is saved.
    
    Thanks to @yarikoptic for the suggestion!
  3. Set `ANSIBLE_FORKS` to 4 times number of CPUs.

    riccardomurri committed May 6, 2019
    It's impossible to give a good default (depends on network speed and
    remote I/O more than on local CPU power), but this is certainly better
    than the old hard-coded value of 5.
Commits on Apr 26, 2019
  1. Bump version: 1.3.dev11 → 1.3.dev12

    riccardomurri committed Apr 26, 2019
  2. Azure: better link for the "API profile 2018-03-01-hybrid"

    riccardomurri committed Apr 26, 2019
    Thanks to @manuelesimi for the amendment!
  3. Azure: new options for using an alternate VM or net deployment template.

    riccardomurri committed Apr 26, 2019
    See discussion at #633
    for the motivation.
  4. Azure: New node-level option `storage_account_type`.

    riccardomurri committed Apr 26, 2019
    Allows to decide what kind of disks will be attached to the VM,
    e.g. standard rotating HDDs (`Standard_LRS`) or SSDs with guaranteed
    IOps (`UltraSSD_LRS`).
Commits on Apr 23, 2019
  1. Rename `test__main__.py` to `test_cli.py`.

    riccardomurri committed Apr 23, 2019
    I find it more readable.
  2. Fix tests of CLI invocation.

    riccardomurri committed Apr 23, 2019
    Run the actual `elasticluster` command instead of trying to invoke the
    classes directly (which requires monkey patching, intercepting
    interpreter exits, etc.)
  3. Include playbook `roles/hpc-common.yml`.

    riccardomurri committed Apr 23, 2019
    Fixes #636
  4. Use different `module` tools on Debian/Ubuntu and RHEL/CentOS.

    riccardomurri committed Apr 23, 2019
    Make the `module` tool default to Lmod on Debian/Ubuntu and use
    instead the TCL-based `environment-modules` on RHEL/CentOS.
    
    The reason for this distribution-dependent choice is twofold:
    
    - As of Debian 9 and Ubuntu 18.04, the `environment-modules` packages
      brings in a lot of dependencies (including GCC and many development
      libraries), whereas package `lmod` only has the minimal dependencies
      one would expect.
    
    - The EPEL package for OpenMPI depends on `environment-modules` (and
      possibly other HPC stuff) so it makes little sense to use a
      different modules tool on RHEL/CentOS.
Commits on Apr 19, 2019
  1. Use HTTPS instead of plain HTTP to download RStudio packages.

    riccardomurri committed Apr 19, 2019
    Fixes #634
Commits on Apr 18, 2019
  1. Fix typo.

    riccardomurri committed Apr 18, 2019
  2. Bump version: 1.3.dev10 → 1.3.dev11

    riccardomurri committed Apr 18, 2019
  3. Make "HPC common" an (optional) add-on.

    riccardomurri committed Apr 18, 2019
    Trtying to get batch-queuing cluster installations leaner, we just
    install OpenMPI by default and leave the "standard" HPC stuff for
    those who opt in to it.
  4. HPC common: depend on the new `openmpi` role.

    riccardomurri committed Apr 18, 2019
    Do not do OpenMPI installation and configuration here; eventually, we
    might want to have the MPI implementation selectable through some
    variable (to use e.g. MPICH-2 instead).
  5. New role `openmpi` to install OpenMPI.

    riccardomurri committed Apr 18, 2019
    At the moment, no customization is provided -- it just installs
    whatever is provided by the Linux distribution under the name
    `openmpi` and ensure there is a module file to load it.
  6. Make "HPC common" and "R" depend on the generic `modules` tool.

    riccardomurri committed Apr 18, 2019
    No need to depend on a specific variant like Lmod since we do not use
    any of the features that Lmod only provides.
  7. HPC common: Install a TCL modules file for OpenMPI

    riccardomurri committed Apr 18, 2019
    Both the TCL-based `environment-modules` and Lmod can use TCL module
    files, whereas the Lua-based ones are only compatible with Lmod.
    
    Furthermore, the module file is only installed on Debian/Ubuntu VMs,
    as RHEL/CentOS' OpenMPI package already ships an `mpi/openmpi-x86_64`
    module.
  8. New role `modules-tool` to install `Lmod` or `environment-modules`.

    riccardomurri committed Apr 18, 2019
    This new role will install one or the other tool depending on the
    value of variable `modules_tool`.  If the variable is unset, default
    is to install the TCL-based `environmemt-modules` because:
    
    1. It is automatically pulled in on RHEL/CentOS by standard HPC
       packages like OpenMPI;
    
    2. It has better support and packaging at the distro
       level (e.g. Debian/Ubuntu packages for Lmod lacked a shell profile
       script until recent versions).
  9. New role `environment-modules` to install the TCL-based environment m…

    riccardomurri committed Apr 18, 2019
    …odules tool.
    
    No actual module files are installed by the tool, only the
    implementation of the shell `module` command is provided.
Commits on Apr 17, 2019
  1. Bump version: 1.3.dev9 → 1.3.dev10

    riccardomurri committed Apr 17, 2019
Older
You can’t perform that action at this time.