Skip to content

tech stack added and pre-requisites to getting started #84

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
HPSLU wants to merge 3 commits into
base: main
Choose a base branch
from
Open

tech stack added and pre-requisites to getting started #84

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
fb4e3a2
tech stack added and pre-requisites to getting started
HPSLU Apr 30, 2026
1ff5a9d
Merge branch 'main' into HP-41-update-documentation
HPSLU Jul 29, 2026
2d2415a
Revise installation steps in README
HPSLU Sep 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 18 additions & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,28 @@ This project provides data tools and low friction access to versioned datasets w
- Utilities for time-stamping and template loading
- Data validation and quality checks
- Custom workflows
- Tooling for easy access to Socrata Open Data API (e.i., data.cdc.gov) (copied and modified from [here](https://github.com/CDCgov/cfasodapy))
- Tooling for easy access to Socrata Open Data API (data.cdc.gov) (copied and modified from [here](https://github.com/CDCgov/cfasodapy))
- Ability to initialize new dataset catalog libraries and maintain datasets in more than one repo

## Technology Stack
- DuckDB (in-process analytics engine)
- Polars (high-performance data frame library)
Comment thread
HPSLU marked this conversation as resolved.
- Azure Blob Storage (centralized data storage)
- Dagster (workflow orchestration, emerging)
- Pandas (data manipulation and analysis python library)
- Socrata API (public health data access)

## Getting started

### Prequisites
Before getting started, ensure you have:
- GitHub access to this repository
- Azure credentials (Blob storage, VPC access)
- Python and Git installed

### Steps
1. Clone the repository and install dependencies with `uv`
2. Ensure your have access to the relevant resources (e.g.`az login --identity`)
1. Clone the repository and install dependencies with `uv sync`
2. Ensure you have access to the relevant resources (e.g., `az login --identity`)
3. See which datasets are available:
Expand Down