Containerize agentic AI example application #17

manju956 · 2025-07-30T10:09:57Z

Contains separate Containerfiles for HMC server and Client
logic to parse HMC related configurations and pass to HMC server and client
Modifications in HMC server to run on different port
Modifications in HMC client to accept OPENAI_BASE_URL and MCP_SERVER_URL at runtime

dharaneeshvrd

Add a README under examples/hmc-agent, explaining the expected configs need to be set by the user.
Also instructions on how to build
Add a README inside app also what's what and steps to build server and agent containers.

config.ini

dharaneeshvrd · 2025-07-30T10:18:43Z

examples/hmc-agent/app/agent.py

@@ -54,7 +55,10 @@ async def interactive_chat(self):

 async def main():
    try:
-        client = MCPClient()
+        model = os.getenv("OLLAMA_MODEL")


Its not OLLAMA_MODEL right?
extract it from llm.conf

this is model param from llmArgs, will rename it

examples/hmc-agent/hmc_agent.container

examples/hmc-agent/hmc_config.sh

dharaneeshvrd · 2025-07-30T10:25:13Z

examples/hmc-agent/hmc_config.sh

+var_to_add=MCP_SERVER_URL=$(jq -r '.mcpServerURL' /etc/pim/pim_config.json)
+sed -i "/^MCP_SERVER_URL=.*/d" /etc/pim/hmc.conf && echo "$var_to_add" >> /etc/pim/hmc.conf


Are you expecting this so that user need to set it directly via ip instead of localhost:8003/sse?

I am expecting user to provide MCP server URL with PIM partition's IP eg: http://9.114.98.3:8003/sse

examples/hmc-agent/app/agent.py

manju956 · 2025-07-31T14:56:33Z

Add a README under examples/hmc-agent, explaining the expected configs need to be set by the user. Also instructions on how to build Add a README inside app also what's what and steps to build server and agent containers.

Addressed documentation. ptal

dharaneeshvrd · 2025-08-01T05:07:13Z

examples/hmc-agent/README.md

+
+## Configuration
+
+Since vLLM AI image can be used as a base for many LLM inferencing applications like chatbot, entity extraction and many more.  Below provided configurations tune the vLLM engine as per the AI use case. 


Suggested change

Since vLLM AI image can be used as a base for many LLM inferencing applications like chatbot, entity extraction and many more. Below provided configurations tune the vLLM engine as per the AI use case.

Since vLLM AI image can be used as a base for many LLM inferencing applications like chatbot, entity extraction and many more. Below provided configurations tune the vLLM engine as per the HMC Agent AI use case.

examples/hmc-agent/README.md

examples/hmc-agent/app/README.md

examples/hmc-agent/README.md

examples/hmc-agent/app/server.py

examples/hmc-agent/app/agent.py

examples/hmc-agent/app/Containerfile-agent

examples/hmc-agent/hmc_server.container

examples/hmc-agent/app/server.py

dharaneeshvrd · 2025-08-05T04:10:07Z

How much is the final image size Mac?

adarshagrawal38 · 2025-08-05T04:25:14Z

How much is the final image size Mac?

It is around 1.6 GB

dharaneeshvrd · 2025-08-05T04:28:27Z

Cool, how about after installing pyarrow and streamlit?

adarshagrawal38 · 2025-08-05T04:31:11Z

Cool, how about after installing pyarrow and streamlit?

Streamlit installation was falling yesterday, will take the updated Container file and try again

dharaneeshvrd · 2025-08-05T04:31:51Z

@manju956 please squash the commits before merging

Signed-off-by: Manjunath-A-C <[email protected]>

manju956 requested review from dharaneeshvrd and adarshagrawal38 July 30, 2025 10:09

manju956 self-assigned this Jul 30, 2025

manju956 added the enhancement New feature or request label Jul 30, 2025

manju956 force-pushed the hmc_agent branch from d1b6ac6 to d948cab Compare July 30, 2025 10:12

dharaneeshvrd requested changes Jul 30, 2025

View reviewed changes

adarshagrawal38 reviewed Jul 31, 2025

View reviewed changes

examples/hmc-agent/app/agent.py Show resolved Hide resolved

manju956 force-pushed the hmc_agent branch from f5ce9ef to a421953 Compare July 31, 2025 14:54

dharaneeshvrd reviewed Aug 1, 2025

View reviewed changes

examples/hmc-agent/README.md Outdated Show resolved Hide resolved

manju956 force-pushed the hmc_agent branch from 86d43f3 to 5bcb019 Compare August 1, 2025 09:16

dharaneeshvrd reviewed Aug 1, 2025

View reviewed changes

examples/hmc-agent/app/server.py Outdated Show resolved Hide resolved

examples/hmc-agent/app/agent.py Show resolved Hide resolved

examples/hmc-agent/app/Containerfile-agent Outdated Show resolved Hide resolved

examples/hmc-agent/hmc_server.container Outdated Show resolved Hide resolved

manju956 force-pushed the hmc_agent branch from f6b1353 to 00b301c Compare August 1, 2025 14:48

dharaneeshvrd reviewed Aug 1, 2025

View reviewed changes

examples/hmc-agent/app/server.py Outdated Show resolved Hide resolved

dharaneeshvrd approved these changes Aug 5, 2025

View reviewed changes

manju956 force-pushed the hmc_agent branch from 063a52d to 7f102dc Compare August 5, 2025 05:48

manju956 added 8 commits August 5, 2025 11:19

Containerize HMC agent application

c8e4dd6

Signed-off-by: Manjunath-A-C <[email protected]>

Populate HMC agent env variables in a file

7895744

Signed-off-by: Manjunath-A-C <[email protected]>

Extem pim-config.json to include hmc details

29fcc63

Signed-off-by: Manjunath-A-C <[email protected]>

Restructure HCM agent and server services

9358f9b

Signed-off-by: Manjunath-A-C <[email protected]>

Pass open AI base URL from pim_config

67dba80

Signed-off-by: Manjunath-A-C <[email protected]>

Fix issues with HMC agent and server communication

09be0b5

Signed-off-by: Manjunath-A-C <[email protected]>

revert HMC config changes in iso_util.py

6b2177a

Signed-off-by: Manjunath-A-C <[email protected]>

Add documentation on usage of HMC server and agent

5d851b3

Signed-off-by: Manjunath-A-C <[email protected]>

manju956 added 5 commits August 5, 2025 11:19

Add steps to build PIM HMC agent image

da10e6e

Signed-off-by: Manjunath-A-C <[email protected]>

Remove OpenAIBaseURL and MCPServerURL from config.ini

e66423f

Signed-off-by: Manjunath-A-C <[email protected]>

add vllm as prerequisite for hmc agent service

1422a7e

Signed-off-by: Manjunath-A-C <[email protected]>

remove unused imports

20e6d84

Signed-off-by: Manjunath-A-C <[email protected]>

Combine HMC server and agents container images to single image

9c82f9b

Signed-off-by: Manjunath-A-C <[email protected]>

manju956 force-pushed the hmc_agent branch from 7f102dc to 9c82f9b Compare August 5, 2025 05:50

manju956 merged commit b71959c into main Aug 5, 2025
1 check passed

dharaneeshvrd deleted the hmc_agent branch August 29, 2025 05:16

		var_to_add=MCP_SERVER_URL=$(jq -r '.mcpServerURL' /etc/pim/pim_config.json)
		sed -i "/^MCP_SERVER_URL=.*/d" /etc/pim/hmc.conf && echo "$var_to_add" >> /etc/pim/hmc.conf


		## Configuration

		Since vLLM AI image can be used as a base for many LLM inferencing applications like chatbot, entity extraction and many more. Below provided configurations tune the vLLM engine as per the AI use case.

Containerize agentic AI example application #17

Containerize agentic AI example application #17

Uh oh!

Conversation

manju956 commented Jul 30, 2025

Uh oh!

dharaneeshvrd left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

dharaneeshvrd Jul 30, 2025

Choose a reason for hiding this comment

Uh oh!

manju956 Jul 30, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

dharaneeshvrd Jul 30, 2025

Choose a reason for hiding this comment

Uh oh!

manju956 Jul 31, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

manju956 commented Jul 31, 2025

Uh oh!

dharaneeshvrd Aug 1, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

dharaneeshvrd commented Aug 5, 2025

Uh oh!

adarshagrawal38 commented Aug 5, 2025

Uh oh!

dharaneeshvrd commented Aug 5, 2025

Uh oh!

adarshagrawal38 commented Aug 5, 2025

Uh oh!

dharaneeshvrd commented Aug 5, 2025

Uh oh!

Uh oh!

Uh oh!