Time series represents one of the ultimate challenging data modalities despite numerous advancements in the foundation model paradigm. In this talk, I will discuss the challenges of building time series foundation models through the lens of multi-channel encoders, multimodal foundation models, and reasoning over time series and contextual information. The talk will also introduce new benchmarks developed to evaluate these new frontiers in time series foundation models.