Skip to content

Update release v0.1.1#4

Merged
nuzant merged 19 commits into
areal-project:mainfrom
nuzant:update
Mar 4, 2025
Merged

Update release v0.1.1#4
nuzant merged 19 commits into
areal-project:mainfrom
nuzant:update

Conversation

@nuzant

@nuzant nuzant commented Mar 4, 2025

Copy link
Copy Markdown
Collaborator

No description provided.

meizhiyu.mzy and others added 19 commits February 27, 2025 11:36
Merge branch fix-loss-scale of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/1

Signed-off-by: 博惟 <bowei.fw@antgroup.com>
… window and initial loss scale.

Merge branch fw/loss-scale of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/2

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
different seeds for every epoch & every rank
Merge branch whj/fix-dataloader of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/3

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>
Merge branch fw/fix-dataloading-not-shuffle of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/4

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* fw/fix-dataloading-not-shuffle
* .
* .
* .
…vLLM generation.

Merge branch fw/vllm-key-value-alloc of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/7?tab=commit

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* remove pring
Merge branch fw/balanced-datapck of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/5

Signed-off-by: 温差 <xushusheng.xss@antgroup.com>


* .
* fw/fix-dataloading-not-shuffle
* .
* .
* .
* .
* .
Merge branch math_verifier_timeout of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/8

Signed-off-by: 博惟 <bowei.fw@antgroup.com>


* debug: math verifier timeout
* debug: math verifier timeout
* timeout in math_verify_utils
* format
…ecover.

Merge branch fw/fix-recover-filter of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/10

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* cleanup
* cleanup
Merge branch update-tutorial of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/12?tab=comment

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* support setup env and start train
* update tutorial
* update training script
Merge branch fw/update-requirements of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/14

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* format and update requirements.txt
* cleanup
Merge branch 0304-7b-zero-readme of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/13

Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* update 7B zero figures
* update readme
* update amc
* update readme
* Delete Data Comparison
* typo
* update figures
* fix typo
@nuzant nuzant merged commit 940dfb6 into areal-project:main Mar 4, 2025
@nuzant nuzant deleted the update branch March 4, 2025 11:33
dhh1995 pushed a commit that referenced this pull request Oct 16, 2025
update README, add num tasks cli, update python version requirement
zhshgmail pushed a commit to HsiaoTsan/AReaL that referenced this pull request Oct 29, 2025
This commit addresses design issues areal-project#1-areal-project#4 by reorganizing interfaces:

## Changes

**1. Moved to api module (proper location for interfaces):**
- `QueueAPI` → `areal/api/queue_api.py`
- `CacheAPI` → `areal/api/cache_api.py`
- `EventType`, `EventContext`, `EventHandler` → `areal/api/event_api.py`
- `QueueFilter` → `Filter` in `areal/api/filter_api.py`

**2. Created separate queue/cache event handler protocols:**
- `QueueEventHandler` + `QueueEventContext` in `areal/api/queue_event_handler.py`
- `CacheEventHandler` + `CacheEventContext` in `areal/api/cache_event_handler.py`

**3. Simplified event_system.py:**
- Now only contains `EventRegistry` class
- Imports interfaces from api module
- No longer defines protocols

**4. Renamed QueueFilter → Filter:**
- Generic name since it applies to both queue and cache
- Located in api module as proper interface
- StalenessFilter now implements Filter protocol

## Why Protocol as superclass? (Answer to areal-project#4)

Protocol enables **structural subtyping** (duck typing with types):

```python
from typing import Protocol

class QueueAPI(Protocol):
    def put(self, item): ...

# No need to inherit!
class MyQueue:
    def put(self, item):
        pass

# Type checker accepts this ✓
def foo(q: QueueAPI):
    q.put(1)

foo(MyQueue())  # Works! Structural typing
```

vs ABC (requires inheritance):
```python
from abc import ABC

class QueueAPI(ABC):
    ...

class MyQueue:  # Must inherit from QueueAPI
    ...
```

**Protocol = Interface without inheritance requirement**

## Remaining Work

Still TODO (per user feedback):
- Redesign ProximalRecomputer with propagator pattern (areal-project#3)
- Fix AsyncTaskRunner to require QueueAPI/CacheAPI (areal-project#5)
- Remove executor._filter_context (areal-project#6)
- Add CacheFilter or apply Filter to all operations (areal-project#7, areal-project#8)
- Fix RemoteInfEngine to not expose queue/cache (areal-project#9)
- Merge event_factory into workflow_factory (areal-project#10)
- Add vLLM recompute support (areal-project#11)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
edbeeching pushed a commit to edbeeching/AReaL that referenced this pull request Mar 20, 2026
* revert: remove kernels example config

Co-authored-by: OpenAI Codex <codex@openai.com>

* docs: explain how to enable kernels in training

Co-authored-by: OpenAI Codex <codex@openai.com>

* docs: link Hugging Face kernels docs

Co-authored-by: OpenAI Codex <codex@openai.com>

* docs: apply README suggestion

Co-authored-by: OpenAI Codex <codex@openai.com>

* refactor: share attn_impl validation

Co-authored-by: Codex <codex@openai.com>

* refactor: reuse transformers kernel validator

Co-authored-by: OpenAI Codex <codex@openai.com>

* fix: move attn impl validation into fsdp utils

Co-authored-by: OpenAI Codex <codex@openai.com>

---------

Co-authored-by: OpenAI Codex <codex@openai.com>
guozhihao-224 added a commit to guozhihao-224/AReaL that referenced this pull request Apr 18, 2026
…, and metrics

Fix high-priority documentation issues that can directly cause user errors:

1. **Proxy endpoints** (agent_workflow.md): Fix paths from /v1/chat/completions
   and /v1/responses to /chat/completions and /responses. The OpenAI SDK puts
   /v1/ in the base_url, not in the request path.

2. **Rollout config** (rollout_workflow.md): Remove non-existent
   rollout.group_size YAML config (group_size is a runtime API parameter).
   Fix trajectory dump path to include /logs/{user}/ segment.

3. **LoRA support** (cli_reference.md, lora.md, cli_args.py): Update "Only
   support FSDP" to include Megatron (requires megatron-bridge). Add note
   that SGLang LoRA requires weight_update_mode: disk.

4. **Metrics tracking** (metrics_tracking.md): Fix SwanLab mode from "online"
   (invalid) to "cloud". Add Trackio as a supported logging backend.

Ref: areal-project#1165 (Findings areal-project#3, areal-project#4, areal-project#5, areal-project#8, areal-project#9, areal-project#14, areal-project#15)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants