[Flight] Warn once if eval is disabled in dev environment (#35661)

[Flight] Warn once if eval is disabled in dev environment (#35661) #10728