greatlakes-hpc-setup

Configures new UMich Great Lakes HPC accounts with stow-based dotfiles, conda, and SLURM tooling.

1|Updated Oct 25, 2020
One-click install
npx skills add https://github.com/bfairkun/dotfiles --skill greatlakes-hpc-setup-bfairkun
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: greatlakes-hpc-setup
Source: https://github.com/bfairkun/dotfiles/tree/main/agents/.agents/skills/greatlakes-hpc-setup
Command: npx skills add https://github.com/bfairkun/dotfiles --skill greatlakes-hpc-setup-bfairkun

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Setting up a fresh account on the University of Michigan Great Lakes HPC cluster involves dozens of cluster-specific quirks — LDAP-managed login shells, a 4 GB login-node memory cap, broken stow options, and no crontab — that turn onboarding into hours of trial and error. This Skill walks an agent through the entire setup in the correct order, explaining each step in plain language for users new to HPC. ## Core Features & Use Cases - Phased dotfiles installation: Clones the dotfiles repo and links packages with GNU Stow using the exact Great Lakes package list, avoiding other machines' configs. - Cluster-aware environment setup: Installs miniconda, micromamba, the py_general conda environment (on SLURM compute nodes to dodge the memory cap), Quarto, fzf, and vim plugins. - Documented quirks and fixes: Covers the broken stow --restow, the readonly TMOUT shell crash, old system tmux, compute-node proxy access, and SLURM account/partition conventions. - Use Case: A new lab member gets a Great Lakes account and asks the agent to set it up; the agent runs each phase in order, explains why bash must stay the login shell, and creates the analysis environment via an srun job. ## Quick Start Set up my new Great Lakes HPC account using the greatlakes-hpc-setup skill, starting with cloning the dotfiles and stowing the packages.

Frequently Asked Questions about greatlakes-hpc-setup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up dotfiles on a new HPC cluster account?▼

Clone the dotfiles repository into your home directory and use GNU Stow to symlink each package (bash, tmux, git, bin, and others) into place. On Great Lakes, run the shipped stow binary via perl first, then stow only the Great Lakes package list.

How to create a conda environment when the login node kills the solver?▼

Use micromamba instead of conda and run the environment creation on a SLURM compute node via srun with enough memory, such as 16 GB. The login node's 4 GB per-user cgroup limit silently kills large conda solves.

Can I change my login shell to zsh on Great Lakes?▼

No. Great Lakes uses LDAP for accounts, so chsh changes to local /etc/passwd are overridden and do not persist. The login shell stays bash, and all interactive configuration should go in .bashrc_local.

Why does stow --restow hang and consume gigabytes of memory?▼

The bundled stow version 1.3.2 has a broken --restow option that crawls the filesystem until the login node's memory cgroup kills it. Use plain stow <package> to add links, or stow -D <package> followed by stow <package> to force a relink.

How do compute nodes access the internet on Great Lakes?▼

Compute nodes have no direct internet but can use the ARC-TS proxy by sourcing /etc/profile.d/http_proxy.sh inside the job script. Do not hardcode the proxy hostname, since the system file selects the correct one.