Hello, I am currently using the ttab framework to implement the evaluation under the CTTA scenario. However, I have found that although ttab provides CTTA methods such as CoTTA, it does not offer an evaluation setup for CTTA (i.e., data streams that switch domains over time, with evaluation results provided for each domain in the data stream). Could it be that ttab has settings for CTTA that I have not discovered? (I have already found that I can combine multiple datasets from different domains in the data_names, but I have not found a specific evaluation setup for a single domain.)
Hello, I am currently using the ttab framework to implement the evaluation under the CTTA scenario. However, I have found that although ttab provides CTTA methods such as CoTTA, it does not offer an evaluation setup for CTTA (i.e., data streams that switch domains over time, with evaluation results provided for each domain in the data stream). Could it be that ttab has settings for CTTA that I have not discovered? (I have already found that I can combine multiple datasets from different domains in the
data_names, but I have not found a specific evaluation setup for a single domain.)