Switching from oil, propane, or electric resistance heating results in significant annual savings on energy in virtually all scenarios.
More myths and barriers here.