Skip to content

Commit 2d2325c

Browse files
committed
uncomment flash error captureg
1 parent 20bda42 commit 2d2325c

File tree

1 file changed

+5
-5
lines changed
  • backends/python/server/text_embeddings_server/models

1 file changed

+5
-5
lines changed

backends/python/server/text_embeddings_server/models/__init__.py

+5-5
Original file line numberDiff line numberDiff line change
@@ -15,11 +15,11 @@
1515
torch.set_grad_enabled(False)
1616

1717
FLASH_ATTENTION = True
18-
# try:
19-
from text_embeddings_server.models.flash_bert import FlashBert
20-
# except ImportError as e:
21-
# logger.warning(f"Could not import Flash Attention enabled models: {e}")
22-
# FLASH_ATTENTION = False
18+
try:
19+
from text_embeddings_server.models.flash_bert import FlashBert
20+
except ImportError as e:
21+
logger.warning(f"Could not import Flash Attention enabled models: {e}")
22+
FLASH_ATTENTION = False
2323

2424
if FLASH_ATTENTION:
2525
__all__.append(FlashBert)

0 commit comments

Comments
 (0)