Using a dynamical systems approach and numerically computing the stable manifold of an equilibrium in the corresponding Hamiltonian systems, we propose a numerical technique for obtaining derivatives of stabilizing solutions to Hamilton-Jacobi equations for nonlinear control systems. We give an example for an inverted pendulum and demonstrate the proposed technique in both numerical simulations and experiments.