Return empty sparsity config if targets and ignores are empty

Return empty sparsity config if targets and ignores are empty #2385