Imported changes from repo VowpalWabbit/rl_chain into rl_chain directory

Author: olgavrou

libs/langchain/langchain/chains/rl_chain/.github/workflows/unit_tests.yml

@@ -0,0 +1,23 @@
+name: Unit Tests
+
+on:
+  push:
+    branches:
+      - main
+  pull_request:
+    branches:
+      - '*'
+
+jobs:
+  python-unit-test:
+    container:
+      image: python:3.8
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v1
+      - name: Run Tests
+        shell: bash
+        run: |
+          pip install -r requirements.txt
+          pip install pytest
+          python -m pytest tests/

libs/langchain/langchain/chains/rl_chain/.gitignore

@@ -0,0 +1,6 @@
+**/__pycache__/**
+models/*
+logs/*
+**/*.vw
+.venv
+

libs/langchain/langchain/chains/rl_chain/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2023 Vowpal Wabbit
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

libs/langchain/langchain/chains/rl_chain/README.md

@@ -0,0 +1,25 @@
+# VW in a langchain chain
+
+Install `requirements.txt`
+
+[VowpalWabbit](https://github.com/VowpalWabbit/vowpal_wabbit)
+
+There is an example notebook (rl_chain.ipynb) with basic usage of the chain.
+
+TLDR:
+
+- Chain is initialized and creates a Vowpal Wabbit instance - only Contextual Bandits and Slates are supported for now
+- You can change the arguments at chain creation time
+- There is a default prompt but it can be changed
+- There is a default reward function that gets triggered and triggers learn automatically
+  - This can be turned off and score can be spcified explicitly
+
+Flow:
+
+- Developer: creates chain
+- Developer: sets actions
+- Developer: calls chain with context and other prompt inputs
+- Chain: calls VW with the context and selects an action
+- Chain: action (and other vars) are passed to the LLM with the prompt
+- Chain: if default reward set, the LLM is called to judge and give a reward score of the response based on the context
+- Chain: VW learn is triggered with that score