Skip to content

Distributed v3 - #148

Merged
inducer merged 440 commits into
mainfrom
distributed-v3
Feb 9, 2022
Merged

Distributed v3#148
inducer merged 440 commits into
mainfrom
distributed-v3

Conversation

@matthiasdiener

@matthiasdiener matthiasdiener commented Aug 30, 2021 •
edited
Loading

Copy link
Copy Markdown
Contributor

See also #65 #139.

Needs:

Required by:

  • create functionality to split according to node types as a class DistributedGraphRuntime or two functions: prepare+execute
    • remove send, recv nodes for codegen
    • replace recv node with placeholder
    • add send’s predecessor to DictOfNamedArrays

image

@matthiasdiener matthiasdiener self-assigned this Aug 30, 2021
@matthiasdiener matthiasdiener changed the title Init with stuff from #65 Distributed v3 Aug 30, 2021
@matthiasdiener matthiasdiener mentioned this pull request Sep 16, 2021
Closed
2 tasks
inducer
inducer reviewed Sep 27, 2021
View reviewed changes
Comment thread pytato/transform.py Outdated
Comment thread pytato/transform.py Outdated
Comment thread pytato/array.py Outdated
@inducer inducer mentioned this pull request Sep 29, 2021
Merged
1 task
@matthiasdiener

matthiasdiener commented Oct 8, 2021

Copy link
Copy Markdown
Contributor Author

@inducer, I think this is ready for another look. In particular, it's not clear to me what post_receives should actually return (it is more than the MPI request?)

inducer
inducer reviewed Oct 12, 2021
View reviewed changes
Comment thread pytato/transform.py Outdated
Comment thread pytato/transform.py Outdated
Comment thread pytato/transform.py Outdated
expr.dtype,
tags=expr.tags)

def map_distributed_send(self, expr: DistributedSend) -> DistributedSend:

@inducer inducer Oct 11, 2021

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As above.

Comment thread pytato/transform.py Outdated
Comment thread pytato/transform.py Outdated
matthiasdiener and others added 23 commits November 1, 2021 16:08
@matthiasdiener
add test
c79c9d5
@matthiasdiener @kaushikcfd
use are_shape_components_equal
8e8b66b 
Co-authored-by: Kaushik Kulkarni <15399010+kaushikcfd@users.noreply.github.com>
@matthiasdiener
fix
22cc5a7
@inducer @matthiasdiener
Add random graph generation
dbe3399
@matthiasdiener
Merge branch 'squeeze' into random_dag
af9fad4
@matthiasdiener
push current state
81de24a
@inducer
Random DAG generator actually tests things
3e99120
@matthiasdiener
Merge branch 'main' into random_dag
c8560ec
@inducer
Fix show_dot_graph invocation that tripped up pylint
db30718
@matthiasdiener
Merge branch 'main' into partition
76d1cb2
@inducer
Merge branch 'random_dag' into partition
e65f9b6
@inducer
Partitioner: Partitions exist even when they have no in/out edges
eeb3cd2
@inducer
Partitioner: Refactor disjointness check into separate function
0945a09
@inducer
get_dot_graph_from_partitions: Do not require toposorted partition list
701b1e5
@inducer
test_partitioner: properly use make_random_dag
ae346d1
@inducer
Move transform functionality to separate file, fix partition type ann…
c64537b 
…otations
@inducer
Use PartitionId type alias for partition IDs
462cf3d
@inducer
Add pytato.partition to docs
a88ca6b
@inducer
Fix flake8 in partition
b0a329f
@inducer
Code folding in pytato.partition
91f3ccd
@inducer
Partition: rename _handle_new_binding -> _handle_parent_child
959b4e5
@inducer
Split EdgeCachedMapper out of graph partitioner
7c0cc4a
@inducer
EdgeCachedMapper: support *args
0355203
@matthiasdiener

matthiasdiener commented Jan 12, 2022

Copy link
Copy Markdown
Contributor Author

I think this is ready for review @inducer.

This was referenced Jan 21, 2022
Merged
Merged
inducer
inducer reviewed Jan 31, 2022
View reviewed changes
Comment thread pytato/partition.py Outdated
Comment thread test/test_distributed.py Outdated
Comment thread pytato/distributed.py Outdated
@inducer inducer mentioned this pull request Feb 1, 2022
Closed
@inducer
inducer enabled auto-merge (squash) February 1, 2022 18:08
@matthiasdiener matthiasdiener mentioned this pull request Feb 8, 2022
Merged
@inducer
inducer enabled auto-merge (squash) February 9, 2022 04:24
@inducer
inducer merged commit 2cfeb0e into main Feb 9, 2022
@inducer
inducer deleted the distributed-v3 branch February 9, 2022 04:55
@matthiasdiener matthiasdiener mentioned this pull request Feb 20, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@inducer inducer inducer left review comments

Assignees

@matthiasdiener matthiasdiener

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@matthiasdiener @inducer