Increase max input length for HuggingFace model in SageMaker deployment


I deployed HuggingFace zephyr-7b-beta model to SageMaker by using the default deploy.py script. When trying to invoke the model endpoint, I received the error "ValueError: Error raised by inference endpoint: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received client error (422) from primary with message "{"error":"Input validation error: inputs must have less than … Continue reading Increase max input length for HuggingFace model in SageMaker deployment →

Use Amazon Q with CodeWhisperer


Today I would like to share how to use Amazon Q with CodeWhisperer. The use cases can be self-learning, code review, bug fixing ... I previously wrote a blog of how to use CodeWhisperer to improve developer's productivity. If you missed it, here you go - "Use Amazon CodeWhisperer for free". In that blog, I explained … Continue reading Use Amazon Q with CodeWhisperer →

Use Amazon Q to create a Tax Return Assistant


Loads of new announcements were made in the last couple days in re:Invent 2023. Since I am particularly interested in the GenAI space, I shared those updates with my team and customers in the format of a Christmas menu 🙂 Personally, the Chef's Special (Amazon Q) is my favourite. In one sentence, it is a … Continue reading Use Amazon Q to create a Tax Return Assistant →