Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate and improve performance of log density evaluation #269

Draft
wants to merge 18 commits into
base: master
Choose a base branch
from

Conversation

sunxd3
Copy link
Member

@sunxd3 sunxd3 commented Jan 21, 2025

No description provided.

@coveralls
Copy link

coveralls commented Feb 2, 2025

Pull Request Test Coverage Report for Build 13560128272

Details

  • 0 of 210 (0.0%) changed or added relevant lines in 1 file are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage decreased (-7.9%) to 74.055%

Changes Missing Coverage Covered Lines Changed/Added Lines %
src/source_gen.jl 0 210 0.0%
Totals Coverage Status
Change from base Build 13514768036: -7.9%
Covered Lines: 1607
Relevant Lines: 2170

💛 - Coveralls

Copy link
Contributor

Benchmark results on macOS (aarch64)

BridgeStan not found at location specified by $BRIDGESTAN environment variable, downloading version 2.6.1 to /Users/runner/.bridgestan/bridgestan-2.6.1
Done!

Stan results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 5.1584 7.23633
pumps 12 0.924469 1.05435
oxford 244 11.2915 13.25
epil 303 32.959 37.0
lsat 1006 101.583 145.291
schools 133 239.25 364.938
beetles 2 0.742513 0.824765
air 5 0.862765 0.962786

JuliaBUGS results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 83.917 266.459
pumps 12 13.5415 17.917
oxford 244 407.812 466.75
epil 303 352.021 602.979
lsat 1006 2258.44 3314.27
schools 133 2936.13 8049.83
beetles 2 9.27767 11.6875
air 5 7.75 8.43067

JuliaBUGS source gen (Mooncake) results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 1.24304 7.5
pumps 12 0.674242 2.1285
oxford 244 19.708 53.708
epil 303 8.43033 38.667
lsat 1006 48.25 243.459
schools 133 91.417 697.979
beetles 2 1.03241 3.99317
air 5 0.257479 1.16832

JuliaBUGS source gen (Enzyme) results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 1.46875 1.63476
pumps 12 0.491397 1.08641
oxford 244 18.292 23.208
epil 303 7.51367 10.1665
lsat 1006 42.917 207.458
beetles 2 1.10496 1.71613
air 5 0.252904 0.504167

Benchmark results on Ubuntu (x64)

BridgeStan not found at location specified by $BRIDGESTAN environment variable, downloading version 2.6.1 to /home/runner/.bridgestan/bridgestan-2.6.1
Done!

Stan results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 5.1816 7.38367
pumps 12 0.9748 1.23839
oxford 244 13.6855 16.09
epil 303 27.381 33.683
lsat 1006 164.679 201.512
schools 133 469.938 706.531
beetles 2 0.838429 0.977893
air 5 0.6452 0.801486

JuliaBUGS results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 75.812 89.868
pumps 12 12.0625 6.472
oxford 244 366.896 185.978
epil 303 290.644 242.884
lsat 1006 2070.69 1230.13
schools 133 1943.28 3852.95
beetles 2 7.36067 3.479
air 5 6.675 2.42033

JuliaBUGS source gen (Mooncake) results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 2.14554 13.6655
pumps 12 0.627417 2.8263
oxford 244 23.243 73.047
epil 303 11.4765 55.173
lsat 1006 74.522 331.861
schools 133 107.612 1128.14
beetles 2 1.10977 4.85233
air 5 0.341025 1.3906

JuliaBUGS source gen (Enzyme) results:

Model Parameters Density Time (µs) Density+Gradient Time (µs)
rats 65 2.1025 2.58391
pumps 12 0.617957 1.03927
oxford 244 23.153 20.929
epil 303 11.5065 16.19
lsat 1006 75.681 283.792
beetles 2 1.09911 1.94567
air 5 0.340632 0.362329

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants