AutoGrad v1.1.1 Performance Improvements

• General performance improvements.
• Val()->Arg{}
• Result(x, f, args...; kwargs...)->Result(x, f, args, kwargs)
• Improved display for Tapes.
• Using TimerOutputs to profile core.jl. Use AUTOGRAD_TIMER environment variable.
• Added gcnode() to save memory, overriding in Knet to free GPU arrays.
• Added Node.children to be used by gcnode in Knet.

AutoGrad v1.1.0 New interface with grad and @diff

Fixed uncat ambiguity.

AutoGrad v1.0.1 Release Notes

• Using forw and back methods instead of the recorder function generator and the Grad type.
• New gradcheck method checks all arguments, handles tuples and dicts as well as arrays.
• Memory saving by erasing outgrads from tape after use (@ekinakyurek).
• Fixed integer powers and matrix powers.
• Fixed sum_outgrads_array bug causing incorrect grad when indexing into a matrix of vectors #73.
• Fixed sum_outgrads bug so arrays of different types can be added #71.
• Robust Float32 testing added #87 (@ekinakyurek).
• Cleaned up and documented the handling of broadcasting.
• Codecov support added.

AutoGrad v1.0.0 Release Notes

• Julia 1.0 compatibility release (pre-0.7 Julia versions no longer supported) (@rened, @CarloLucibello).
• Higher order gradient bug fixed (@MikeInnes).
• Improved unit tests (@ekinakyurek).

AutoGrad v0.1.0 Release Notes

AutoGrad v0.1.0 Release Notes

2018-05-30

• Pre-0.6 Julia versions no longer supported.
• LinAlg support (@CarloLucibello): det, logdet, inv, dot, diag, diagm, trace, logabsdet, kron, triu, tril, chol, lq, qr, svd
• Added grads for std, var, Int^Int (@CarloLucibello)
• Added f(Rec(::Type{T}) = f(T) for eltype, ndims, one, zero (@CarloLucibello)
• Fixed reduction of scalars, e.g. grad(sum)(3.1) (@CarloLucibello)
• Fixed similar(::Rec{KnetArray}, ::Dims)

Note: this is identical to v0.0.11 but I had to update the version number.

AutoGrad v0.0.11 Release Notes

• LinAlg support (@CarloLucibello): det, logdet, inv, dot, diag, diagm, trace, logabsdet, kron, triu, tril, chol, lq, qr, svd
• Added grads for std, var, Int^Int (@CarloLucibello)
• Added f(Rec(::Type{T}) = f(T) for eltype, ndims, one, zero (@CarloLucibello)
• Fixed reduction of scalars, e.g. grad(sum)(3.1) (@CarloLucibello)
• Fixed similar(::Rec{KnetArray}, ::Dims)

AutoGrad v0.0.10 Release Notes

• Pre-0.6 Julia versions no longer supported.
• Fixed gradient output type for erf family (@CarloLucibello).
• Added mean(x,dims) (@CarloLucibello).
• Added support for Dict iteration.
• Added profiling support inspired by TimerOutputs.jl.

v0.0.9

• Added SpecialFunctions for Julia 0.6+.
• Fixed test problem with broadcast#log.
• Implemented cat1d, an efficient cat function for many arguments.

AutoGrad v0.0.8 Julia6 compat release

• Julia v0.6.0 compatibility fixes by @ylxdzsw #24. Now compatible with Julia v4, v5, and v6.
• Switched to new Base.Test functionality added in Julia v0.5.
• Fix size(rec,d1,d2,ds...) from @CarloLucibello #19.
• Fix depwarn from @mdpradeep #23.
• Generalize cat implementation to work with any number of arguments.
• Fix sign bug in derivatives for minabs/maxabs.

AutoGrad v0.0.7 bugfix release

• Fixed getindex bug effecting repeated indices.
• Fixed minor bug in @zerograd which did not handle some type declarations.
• dumptape() and AutoGrad.debugtape(::Bool) utilities for debugging.