Commit Graph

294 Commits

Author SHA1 Message Date
Vijay Janapa Reddi
c4f25fe97c Add ML systems content to Module 14 (Benchmarking) - 75% implementation
- Added ProductionBenchmarkingProfiler class with end-to-end profiling
- Implemented resource utilization monitoring and bottleneck detection
- Added A/B testing framework with statistical significance
- Included performance regression detection and capacity planning
- Added comprehensive ML systems thinking questions
2025-09-15 23:53:04 -04:00
Vijay Janapa Reddi
36edc9f441 Add ML systems content to Module 13 (Kernels) - 70% implementation
- Added KernelOptimizationProfiler class with CUDA performance analysis
- Implemented memory coalescing and warp divergence analysis
- Added tensor core utilization and kernel fusion detection
- Included multi-GPU scaling patterns and optimization
- Added comprehensive ML systems thinking questions
2025-09-15 23:52:59 -04:00
Vijay Janapa Reddi
157eff36dd Add ML systems content to Module 12 (Compression) - 65% implementation
- Added CompressionSystemsProfiler class with quantization analysis
- Implemented hardware-specific optimization patterns
- Added inference speedup and accuracy tradeoff measurements
- Included production deployment scenarios for mobile, edge, and cloud
- Added comprehensive ML systems thinking questions
2025-09-15 23:52:54 -04:00
Vijay Janapa Reddi
2e5bbcce3c Simplify module structure and remove confusing 5 C's framework
- Clean up CLAUDE.md module structure from 10+ parts to 8 logical sections
- Remove confusing 'Concept, Context, Connections' framework references
- Simplify to clear flow: Introduction → Background → Implementation → Testing → Integration
- Keep Build→Use→Understand compliance for Education Architect
- Remove thinking face emoji from ML Systems Thinking section
- Focus on substance over artificial framework constraints
2025-09-15 20:12:36 -04:00
Vijay Janapa Reddi
e2cf68e2d8 Enhance module structure with ML systems thinking questions and clean organization
- Add ML systems thinking reflection questions to Module 02 tensor
- Consolidate all development standards into CLAUDE.md as single source of truth
- Remove 7 unnecessary template .md files to prevent confusion
- Restore educational markdown explanations before all unit tests
- Establish Documentation Publisher agent responsibility for thoughtful reflection questions
- Update module standards to require immediate testing pattern and ML systems reflection
2025-09-15 20:12:04 -04:00
Vijay Janapa Reddi
be6ac663b9 Fix markdown format issues and prevent agent overlap
CRITICAL FIX:
- Fixed tensor_dev.py markdown cells from comments to triple quotes
- All markdown content now visible in notebooks again
- Added CRITICAL markdown format rule to template

WORKFLOW IMPROVEMENTS:
- Added AGENT_WORKFLOW_RESPONSIBILITIES.md with clear lane division
- Each agent is expert in their domain only
- No overlap: Education Architect ≠ Documentation Publisher ≠ Module Developer

Agent responsibilities:
- Education Architect: learning strategy only
- Module Developer: code implementation only
- Quality Assurance: testing validation only
- Documentation Publisher: writing polish only
2025-09-15 19:43:27 -04:00
Vijay Janapa Reddi
fb8b264b86 Update Module Developer agent and add Module 02 restructure
- Enhanced Module Developer agent with balance philosophy
  - Preserve educational content while adding structure
  - Keep Build→Use→Understand flow
  - Maintain verbose but valuable explanations

- Created restructured Module 02 (Tensor)
  - Added 5 C's framework as enhancement not replacement
  - Preserved ALL educational content
  - Separated implementation from testing
  - Added comparison report showing 100% content preservation

- Added TITO CLI Developer agent for CLI enhancements
- Added CLAUDE.md with git best practices
- Added tito module view command (in progress)
- Generated setup_dev notebook
2025-09-15 19:03:09 -04:00
Vijay Janapa Reddi
357b8cd5bb Revert "Restructure Module 02 (Tensor) with unified template"
This reverts commit 12da3d9f99762d789e6416ac736331fac98ab8d0.
2025-09-15 18:39:29 -04:00
Vijay Janapa Reddi
f8632b6021 Restructure Module 02 (Tensor) with unified template
- Add 5 C's framework for systematic concept understanding
- Separate implementation from testing for clearer learning flow
- Consolidate 15+ fragmented markdown cells into 4 focused sections
- Create clean progression: Concept → Implementation → Test → Usage
- Establish model structure for other modules to follow
2025-09-15 18:17:27 -04:00
Vijay Janapa Reddi
20256828c6 Merge branch 'feature/enhance-module-04-layers' into dev 2025-09-15 15:23:43 -04:00
Vijay Janapa Reddi
4e276407d9 Merge branch 'improve/modules-01-02-standards' into dev 2025-09-15 15:23:39 -04:00
Vijay Janapa Reddi
95c872f6aa Update Module 01 to standardized 5 C's format
Apply the new standardized format to both sections:
- Personal Information Configuration (line ~210)
- System Information Queries (line ~424)

Changes:
- Replace verbose numbered sections with integrated code-comment format
- Use exact '### Before We Code: The 5 C's' heading
- Present all content within scannable code blocks
- Add compelling closing statements
- Preserve all educational content and technical details

Both Module 01 and Module 02 now use the same standardized
5 C's format defined in FIVE_CS_FORMAT_STANDARD.md
2025-09-15 15:01:42 -04:00
Vijay Janapa Reddi
af9f01b22e Restore complete 5 C's content with improved format and codify standard
Module 02 Updates:
- Restore full 5 C's educational content (CONCEPT, CODE STRUCTURE, CONNECTIONS, CONSTRAINTS, CONTEXT)
- Use integrated code-comment format for natural flow
- Maintain all essential educational information
- Clear section header: 'Before We Code: The 5 C's'

New Format Standard:
- Create FIVE_CS_FORMAT_STANDARD.md to codify the approach
- Define exact structure for all future modules
- Include complete example with tensor implementation
- Specify when and how to use the format

The 5 C's content is excellent - this improves the presentation
format while preserving all educational value. Students get
complete context before implementation in a natural, scannable format.
2025-09-15 14:48:06 -04:00
Vijay Janapa Reddi
6eb1c5d3e9 Improve 5 C's format: Use integrated code-comment style
Replace verbose bullet format with code-comment approach that:
- Integrates concepts directly with implementation preview
- Shows exactly where each principle applies in actual code
- Feels more natural and less academic
- Maintains educational value while respecting student time
- Bridges gap between understanding and coding

The code-comment style helps students see the connection between
concepts and implementation rather than treating them as separate
academic content.
2025-09-15 14:38:14 -04:00
Vijay Janapa Reddi
3c21f25562 Add 5 C's pattern to Module 02 (Tensor) implementation
- Add comprehensive 5 C's educational framework before Tensor class
- Explain CONCEPT: What tensors are in ML context
- Detail CODE STRUCTURE: What we're building
- Show CONNECTIONS: PyTorch/TensorFlow/NumPy relationships
- Define CONSTRAINTS: Implementation requirements
- Provide CONTEXT: Why tensors matter in ML systems

This completes the educational scaffolding for Module 02, ensuring
students understand WHY they're building tensors before HOW to
implement them.
2025-09-15 14:27:11 -04:00
Vijay Janapa Reddi
af372cf412 Improve Modules 01 and 02 to meet TinyTorch educational standards
Module 01 (Setup) Improvements:
- Fix duplicate grade_id (changed to setup-verification)
- Add comprehensive 5 C's pattern before implementations
- Replace hardcoded instructor data with generic placeholders
- Implement test-immediately pattern after each function
- Add proper NBGrader metadata to all test cells

Module 02 (Tensor) Improvements:
- Move ALL scaffolding outside BEGIN/END SOLUTION blocks
- Add complete 5 C's pattern before Tensor implementation
- Fix test naming to consistent test_unit_* pattern
- Ensure tests run immediately after implementations
- Maintain proper NBGrader metadata with unique grade_ids

Key Standards Applied:
- 5 C's Pattern: Concept, Code Structure, Connections, Constraints, Context
- Test-immediately: Every implementation followed by immediate validation
- NBGrader Ready: Scaffolding outside solutions for student releases
- Professional Standards: Generic data and consistent patterns

These improvements ensure both modules:
1. Pass NBGrader validation for student releases
2. Provide comprehensive educational scaffolding
3. Follow test-immediately pattern for rapid feedback
4. Meet all TinyTorch quality standards
2025-09-15 14:25:49 -04:00
Vijay Janapa Reddi
621be58efa Add generated Jupyter notebooks for tensor and activations modules
- Add tensor_dev.ipynb converted from tensor_dev.py
- Add activations_dev.ipynb converted from activations_dev.py

These notebooks provide interactive learning environments for students
to explore tensor operations and activation functions.
2025-09-15 13:30:20 -04:00
Vijay Janapa Reddi
94482a3b07 Enhance Module 04 (Layers) with comprehensive educational scaffolding
- Add deep mathematical foundation and visual diagrams
- Expand learning goals to connect with production ML systems
- Implement complete TODO/APPROACH/EXAMPLE/HINTS pattern
- Add extensive inline documentation for matrix multiplication
- Enhance Dense layer with detailed initialization strategies
- Create layer-activation integration patterns
- Add production system comparisons (PyTorch, TensorFlow)
- Include real-world architecture examples
- Add comprehensive checkpoint sections
- Expand module summary with industry connections

This enhancement transforms the layers module into a comprehensive
educational resource that deeply explains the mathematical foundation
of all neural networks while maintaining practical implementation focus.
2025-09-15 13:28:47 -04:00
Vijay Janapa Reddi
c03c2a3f03 Removes development heading from notebook
Removes a redundant development heading from the dataloader notebook, streamlining the document's structure and improving readability.
2025-07-20 18:02:37 -04:00
Vijay Janapa Reddi
2a8de2dfcc Add missing markdown documentation to 08_dataloader module
- Add documentation for test_unit_dataset_interface function
- Add documentation for test_unit_dataloader function
- Add documentation for test_unit_simple_dataset function
- Add documentation for test_unit_dataloader_pipeline function
- Ensures every code function has preceding explanatory markdown cell
- Maintains educational clarity and structure
2025-07-20 17:49:03 -04:00
Vijay Janapa Reddi
f6a944349f Add missing markdown documentation to 06_spatial module
- Add documentation for test_unit_convolution_operation function
- Add documentation for test_unit_conv2d_layer function
- Add documentation for test_unit_flatten_function function
- Ensures every code function has preceding explanatory markdown cell
- Maintains educational clarity and structure
2025-07-20 17:47:39 -04:00
Vijay Janapa Reddi
e81e91dad5 Add missing markdown documentation to 05_dense module
- Add documentation for plot_network_architectures function
- Add documentation for MLP class
- Add documentation for test_unit_sequential_networks function
- Add documentation for test_unit_mlp_creation function
- Add documentation for test_unit_network_applications function
- Ensures every code function has preceding explanatory markdown cell
- Maintains educational clarity and structure
2025-07-20 17:46:33 -04:00
Vijay Janapa Reddi
9ae1292e9d Removes development headers
Removes development headers from several files.

These headers were used during the development process and are no longer needed.
2025-07-20 17:41:57 -04:00
Vijay Janapa Reddi
c33f62ca79 Updates markdown headers in development files
Updates markdown headers in development files to improve consistency and readability.

Removes the redundant "🔧 DEVELOPMENT" headers and standardizes the subsequent headers to indicate the purpose of the following code, such as "🧪 Test Your Matrix Multiplication". This change enhances the clarity and organization of the development files.
2025-07-20 17:36:32 -04:00
Vijay Janapa Reddi
cea9118b0a Add section organization to 15_mlops module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 17:30:59 -04:00
Vijay Janapa Reddi
cee4f63e0a Add section organization to 14_benchmarking module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 17:30:18 -04:00
Vijay Janapa Reddi
3427be8780 Add section organization to 13_kernels module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 17:29:39 -04:00
Vijay Janapa Reddi
b635d071be Add section organization to 12_compression module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 17:29:02 -04:00
Vijay Janapa Reddi
fcf1ed5b1d Add section organization to 11_training module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 17:28:21 -04:00
Vijay Janapa Reddi
fcb6623bfc Add section organization to 10_optimizers module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 14:06:19 -04:00
Vijay Janapa Reddi
f63a2bb52b Add section organization to 09_autograd module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 14:05:44 -04:00
Vijay Janapa Reddi
c7af01596e Add section organization to 08_dataloader module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 14:05:03 -04:00
Vijay Janapa Reddi
a2788db356 Add section organization to 07_attention module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 14:04:31 -04:00
Vijay Janapa Reddi
91f7ecac62 Add section organization to 06_spatial module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 14:03:50 -04:00
Vijay Janapa Reddi
dbb6db6ac2 Add section organization to 05_dense module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 14:03:17 -04:00
Vijay Janapa Reddi
35e54335a6 Add section organization to 04_layers module: Add DEVELOPMENT section header
- Insert ## 🔧 DEVELOPMENT header before first test function
- Organizes module according to educational structure guidelines
- Maintains all existing functionality and test execution
- Improves readability and navigation for educational use
2025-07-20 14:01:13 -04:00
Vijay Janapa Reddi
c1775558c6 Add integration test to 15_mlops module: test_module_mlops_tinytorch_integration
- Tests MLOps pipeline integration with complete TinyTorch models and workflows
- Validates performance monitoring with realistic model inference scenarios
- Tests data drift detection with model input features and production data
- Verifies complete MLOps pipeline with TinyTorch Sequential model integration
- Tests retraining triggers with TinyTorch training workflow compatibility
- Validates end-to-end MLOps workflow with comprehensive system health checks
- Positioned before MODULE SUMMARY as per educational structure
2025-07-20 14:00:00 -04:00
Vijay Janapa Reddi
966091c3b5 Add integration test to 03_activations module: test_module_activation_tensor_integration
- Tests activation function integration with Tensor class operations
- Validates that activations preserve Tensor types in neural network contexts
- Tests matrix operations for multi-dimensional neural network layers
- Verifies softmax probability distributions for classification scenarios
- Tests chaining tensor operations with activations for complete workflows
- Positioned before MODULE SUMMARY as per educational structure
2025-07-20 13:59:11 -04:00
Vijay Janapa Reddi
bbf1dd91c9 Add integration test to 02_tensor module: test_module_tensor_numpy_integration
- Tests tensor integration with NumPy arrays and operations
- Validates tensor-NumPy compatibility for scientific computing
- Ensures broadcasting works correctly between tensors and scalars
- Verifies integration with NumPy functions on tensor data
- Positioned before MODULE SUMMARY as per educational structure
2025-07-20 13:57:34 -04:00
Vijay Janapa Reddi
586b7e3f25 Improves clarity of visual understanding sections
Updates loss landscape descriptions to be more easily understood.

Replaces symbols with clearer text in visual explanations of optimizers.
2025-07-20 13:49:40 -04:00
Vijay Janapa Reddi
cc9cdee97d Deprecate AUTO TESTING: Remove run_module_tests_auto from all _dev.py modules. Standardize on full-module test execution for reliable, context-aware testing. 2025-07-20 13:28:10 -04:00
Vijay Janapa Reddi
5041cb6c64 Fix indentation issues in dense module - remove duplicate function and fix __main__ block 2025-07-20 13:08:13 -04:00
Vijay Janapa Reddi
5618daa26e Update test function names from test_integration_* to test_module_* for clearer cross-module testing semantics 2025-07-20 13:03:52 -04:00
Vijay Janapa Reddi
d1d02d3882 Renames and runs integration tests for compression
Refactors integration test names for clarity.

Executes the integration tests to validate the compression functionality.
2025-07-20 13:00:02 -04:00
Vijay Janapa Reddi
fc3417638b Renames training integration test function
Updates the name of the unit test function for training
integration to improve clarity and consistency.

This change ensures the test function name accurately
reflects its purpose.
2025-07-20 12:59:58 -04:00
Vijay Janapa Reddi
6b2d2c184e Removes integration test execution
Stops the automatic execution of the integration test.

This change prevents the test from running every time the module is loaded,
allowing for more focused and controlled testing.
2025-07-20 12:59:54 -04:00
Vijay Janapa Reddi
e30316b8f2 Renames integration test function
Updates the integration test function name for clarity
and consistency within the codebase.
2025-07-20 12:59:51 -04:00
Vijay Janapa Reddi
d950834de4 Removes autogenerated markdown section
Removes a markdown section that appears to be autogenerated documentation, cleaning up the code.
2025-07-20 12:57:02 -04:00
Vijay Janapa Reddi
6b3aa8fcf8 Clean up formatting in layers module 2025-07-20 12:54:57 -04:00
Vijay Janapa Reddi
f4c628782d Fix test function calls in spatial and dataloader modules - move test calls outside __main__ blocks 2025-07-20 12:54:15 -04:00