According to Gray Mayor Stephen Tingen, a contractor hit a 12-inch water main on Bill Conn Parkway around noon on Thursday.
Public works is shutting down water to the area.
The water pressure is expected to be affected until the crack is contained and water towers refilled.
Tingen says fires are a concern when the water pressure is this low around the city.
Check back with 41NBC.com for updates on this story.