If you're on the beta version, you can turn it off in Settings > General > Haptic Level.
If you're on the stable (App Store) build, this feature isn't available yet, but we're planning to release an App Store update within the next few days that will bring this feature (and many others!) to the stable build.