Multiple active arguments? #508

Activity

1. gdalle

   changed the title [-]Automatically gather several active arguments?[/-] [+]Multiple active arguments?[/+] on Sep 28, 2024
2. wsmoses commented on Sep 28, 2024

   

   wsmoses

   on Sep 28, 2024

   More actions

   recopying from slackhole:

   using Enzyme, BenchmarkTools, ADTypes, DifferentiationInterface
   
   mul(a, b) = @inbounds (a[1] * b[1])
   
   const a = [2.0]
   const b = [3.0]
   Enzyme.gradient(Reverse, mul, a, b)
   
   @btime Enzyme.gradient($Reverse, $mul, $a, $b) # 52.496 ns (2 allocations: 128 bytes)
   
   fuse(tup) = mul(tup[1], tup[2])
   
   function bench_di(backend, a, b)
      prep = DifferentiationInterface.prepare_gradient(fuse, backend, (a, b))
      @btime DifferentiationInterface.gradient($fuse, $prep, $backend, $((a, b)))
      return nothing
   end
   
   bench_di(AutoEnzyme(), a, b) #  131.136 ns (4 allocations: 464 bytes)
   
   @btime Enzyme.gradient(Reverse, fuse, $((a, b)) #  129.619 ns (4 allocations: 464 bytes)

   👍React with 👍1Reacted by Guillaume Dalle
3. wsmoses commented on Sep 28, 2024

   

   wsmoses

   on Sep 28, 2024

   More actions

   and

   using Enzyme, BenchmarkTools, ADTypes, DifferentiationInterface, StaticArrays
   
   mul(a, b) = @inbounds a[1] * sum(b)
   
   const a = [2.0]
   const b = @SMatrix ones(8,8)
   Enzyme.gradient(Reverse, mul, a, b)
   
   @btime Enzyme.gradient($Reverse, $mul, $a, $b) #  7.183 μs (13 allocations: 3.45 KiB)
   
   fuse(tup) = mul(tup[1], tup[2])
   
   function bench_di(backend, a, b)
      prep = DifferentiationInterface.prepare_gradient(fuse, backend, (a, b))
      @btime DifferentiationInterface.gradient($fuse, $prep, $backend, $((a, b)))
      return nothing
   end
   
   bench_di(AutoEnzyme(), a, b) #   27.910 μs (164 allocations: 11.50 KiB)
   
   @btime Enzyme.gradient(Reverse, fuse, $((a, b))) #  27.810 μs (163 allocations: 10.97 KiB)
4. gdalle

   added

   coreRelated to the core utilities of the packageRelated to the core utilities of the package

   on Sep 30, 2024
5. JuliaDiff

   locked and limited conversation to collaborators on Jan 17, 2025
6. gdalle

   converted this issue into a discussion #683 on Jan 17, 2025