Skip to content

[AutoDiff] Forward-mode support for variables, generics, tuples, structs. #26743

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
dan-zheng merged 79 commits into from
Sep 19, 2019
+2,038 −330
Merged

[AutoDiff] Forward-mode support for variables, generics, tuples, structs. #26743

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
fb2d647
Merge in work from branch jvp-emitter.
bartchr808 Jul 9, 2019
34fcebe
Init commit.
bartchr808 Jul 10, 2019
571b5e8
WIP.
bartchr808 Jul 10, 2019
1651a78
Make DifferentialEmitter create differential.
bartchr808 Jul 10, 2019
2ce55ec
Merge branch 'tensorflow' into differential-emitter
bartchr808 Jul 10, 2019
a06d54d
Typos and small bugs.
bartchr808 Jul 10, 2019
0ca031b
Get visitApplyInst and visitReturnInst working.
bartchr808 Jul 10, 2019
652a6d7
Remove multi block logic.
bartchr808 Jul 11, 2019
8fd3e44
WIP
bartchr808 Jul 12, 2019
5aeca34
Merge branch 'tensorflow' into differential-emitter
bartchr808 Jul 12, 2019
d04b479
Accidentally removed mapper.
bartchr808 Jul 12, 2019
966c470
Move JVP lower and start adding AdjointValue.
bartchr808 Jul 12, 2019
5883668
Create differential builder.
bartchr808 Jul 15, 2019
f27a2bd
Get value mapping for seed params.
bartchr808 Jul 15, 2019
da8b1d6
PullbackInfo -> LinearMapInfo.
bartchr808 Jul 16, 2019
8aade2f
Get correct output, have retain memory leak.
bartchr808 Jul 16, 2019
17776b5
Move around code.
bartchr808 Jul 16, 2019
e313857
Fix release bug.
bartchr808 Jul 16, 2019
0d7c17c
More cleanup.
bartchr808 Jul 16, 2019
e60e478
More cleanup x2.
bartchr808 Jul 16, 2019
95c7321
Add tangent accumulation.
bartchr808 Jul 16, 2019
e20f3a6
Merge branch 'tensorflow' into differential-emitter
bartchr808 Jul 16, 2019
f20b98a
PR feedback #1.
bartchr808 Jul 16, 2019
3ad5c96
WIP: start adding tests.
bartchr808 Jul 17, 2019
3fb255d
Merge branch 'tensorflow' into differential-emitter
bartchr808 Jul 17, 2019
0973f3f
Fix SIL tests.
bartchr808 Jul 17, 2019
2ac6316
Remove tangent aggregation logic and cleanup.
bartchr808 Jul 19, 2019
75aa17c
Merge branch 'tensorflow' into differential-emitter
bartchr808 Jul 19, 2019
bca2df3
Fix comments, add jvpNegate, add/modify tests, simplify lit flag.
bartchr808 Jul 19, 2019
71db0ca
Merge branch 'tensorflow' into differential-emitter
bartchr808 Jul 22, 2019
d6704c4
Merge in work from var and struct support.
bartchr808 Jul 22, 2019
1a6ba5e
Get diff struct bb mapping fixed.
bartchr808 Jul 23, 2019
14eef90
PR feedback.
bartchr808 Jul 24, 2019
64e334d
Update new test due to upstream changes and existing tests now that J…
bartchr808 Jul 24, 2019
8eb5bf5
PR feedback.
bartchr808 Jul 24, 2019
0b1f430
Fix tests and PR feedback.
bartchr808 Jul 24, 2019
114d2bc
WIP: handle tuple inst.
bartchr808 Jul 23, 2019
5a6cdae
PR feedback.
bartchr808 Jul 24, 2019
667deec
Merge in changes from intial DifferentialEmitter PR.
bartchr808 Jul 24, 2019
c8fac01
[NFC] Fix naming.
dan-zheng Jul 24, 2019
293dca1
PR feedback and additional 'Tracked<Float>' tests.
bartchr808 Jul 25, 2019
4881e7b
[NFC] Small name and spacing changes.
bartchr808 Jul 25, 2019
563a5c2
Merge in changes from base branch 'differential-emitter'.
bartchr808 Jul 25, 2019
95c4121
Get generics almost working.
bartchr808 Jul 26, 2019
e0081e8
Create the differential struct with func reabstraction.
bartchr808 Jul 26, 2019
492cd5b
Start adding tests.
bartchr808 Jul 29, 2019
b7fb007
WIP: more tests.
bartchr808 Jul 30, 2019
d605cc7
Get TF-508 and TF-523 tests case working.
bartchr808 Jul 30, 2019
85fb0e4
Get TF-534 working.
bartchr808 Jul 30, 2019
24434df
Spacing.
bartchr808 Jul 30, 2019
1ac2f35
WIP: handle tuples with Int element.
bartchr808 Jul 31, 2019
a6479e9
Add tuple extract support, TODO tests.
bartchr808 Jul 31, 2019
8ce3c80
WIP: array init.
bartchr808 Aug 1, 2019
a8454a4
Get array init working with Xcode.
bartchr808 Aug 2, 2019
96a5c66
Merge branch 'tensorflow' into differential-emitter
bartchr808 Aug 5, 2019
6889345
Revamp linear map info struct creation.
bartchr808 Aug 9, 2019
9ad0596
Merge branch 'tensorflow' into differential-emitter
bartchr808 Aug 9, 2019
52903c6
Merge branch 'differential-emitter' into differential-emitter-generic…
bartchr808 Aug 9, 2019
726e931
WIP: fix generics
bartchr808 Aug 11, 2019
d023c96
Merge branch 'tensorflow' into differential-emitter-generic-support
bartchr808 Aug 11, 2019
829b681
Squash merge in latest changes from differential-emitter.
bartchr808 Aug 12, 2019
f7cde6b
Squash merge in latest changes from differential-emitter.
bartchr808 Aug 20, 2019
4681cfd
WIP
bartchr808 Aug 20, 2019
d4cfce5
Merge branch 'tensorflow' into differential-emitter-generic-support
bartchr808 Aug 20, 2019
ef84b4b
Make updates for ownership and handle subset autodiff params.
bartchr808 Aug 20, 2019
22d9556
Cleanup.
bartchr808 Aug 20, 2019
c8a0271
Fix tuple support.
bartchr808 Aug 20, 2019
ace0391
merge partial revamp.
bartchr808 Aug 21, 2019
ef2cc0b
Merge branch 'tensorflow' into differential-emitter-generic-support
bartchr808 Aug 21, 2019
bc3ced7
WIP: activity analysis revamp.
bartchr808 Aug 21, 2019
723fbc2
Update broken tests with latest activity analysis and ownership changes.
bartchr808 Aug 21, 2019
b3a80a8
Gardening.
bartchr808 Aug 21, 2019
3032b8d
PR feedback.
bartchr808 Aug 23, 2019
f2540db
Merge branch 'tensorflow' of github.com:apple/swift into differential…
dan-zheng Sep 19, 2019
82e9605
Disabled non-varied result warning.
dan-zheng Sep 18, 2019
73f1176
Differential generation fixes.
dan-zheng Sep 19, 2019
c5ebacc
Cleanup: simplify `getSingleDestructureTupleUser`.
dan-zheng Sep 19, 2019
9ed9448
Cleanup: add todo comments referencing TF-800.
dan-zheng Sep 19, 2019
d3155ed
Assorted cleanup.
dan-zheng Sep 19, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions include/swift/AST/AutoDiff.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -556,6 +556,8 @@ struct AutoDiffAssociatedFunctionKind {

AutoDiffAssociatedFunctionKind() = default;
AutoDiffAssociatedFunctionKind(innerty rawValue) : rawValue(rawValue) {}
AutoDiffAssociatedFunctionKind(AutoDiffLinearMapKind linMapKind)
: rawValue(static_cast<innerty>(linMapKind.rawValue)) {}
explicit AutoDiffAssociatedFunctionKind(StringRef string);
operator innerty() const { return rawValue; }
AutoDiffLinearMapKind getLinearMapKind() {
Expand Down
Loading