In a large saucepan, combine sugar, corn syrup, butter, and condensed milk. Place over medium heat, and bring to a gentle boil, stirring constantly. Once boiling, reduce heat to simmer, and cook for 20 minutes, stirring constantly, until mixture is a light-amber color.