Follow the Money - Hard

Resource Page Link

This is the challenge page where you will review the alerts assigned to you and see the results of the agent in action.

https://pathfinder.automationanywhere.com/challenges/training/TrustworthyBank/RedFlags.html

Control Room Link

This is the link to the control room you will be performing all hands on activities within.

https://aa-community.cloud.automationanywhere.digital/

API Documentation Page Link

The resource below has all the API Documentation for this process.

View API Documentation (YAML)

Action One: Prepare your AI Evaluation

Steps:

  1. In the Control Room sidebar, navigate to AI > Evaluations.
  2. In the top right, click Run evaluation. Take note of where you are and what you see in Select item to evaluate. This is one path to running an evaluation.
  3. Click Automation, found in the left sidebar. In the Folders section, click BAA > Follow the Money > Hard > Tools and find the AI Skill named AMLInvestigationDecisionandFormat and open it.
  4. At the top, click Evaluate > Run Evaluation. Note that you are back where you last were, but the Select item to evaluate section is now populated.
  5. Name your evaluation something you will be able to remember, such as today's date, your use case and your name.
  6. Take note of the evaluation method options.
  7. Click Evaluate manually.
  8. Click Add Dataset.

Action Two: Populate the Data Set and Run the Eval

Steps:

  1. Click Enter Data Manually.
  2. Give your dataset a name.
  3. Copy and paste each block below into its matching field, in order. Note: The Associated Individuals is always just '{}' in our investigations

    Alert 1

    1. Paste into Relevant Accounts:
      Alert 1 - Relevant Accounts - click to copy
    2. Paste into Relevant Associated Individuals:
      Alert 1 - Relevant Associated Individuals - click to copy
    3. Paste into Relevant Businesses:
      Alert 1 - Relevant Businesses - click to copy
    4. Paste into Relevant Transactions:
      Alert 1 - Relevant Transactions - click to copy
    5. Paste into AML Rule:
      Alert 1 - AML Rule - click to copy
    6. Paste into Triggering Transactions:
      Alert 1 - Triggering Transactions - click to copy
    7. Paste into Investigation Subject:
      Alert 1 - Investigation Subject - click to copy
    8. Paste into Expected Output:
      Alert 1 - Expected Output - click to copy
    9. Click Add another input variable and output set.

    Alert 2

    1. Paste into Relevant Accounts:
      Alert 2 - Relevant Accounts - click to copy
    2. Paste into Relevant Associated Individuals:
      Alert 2 - Relevant Associated Individuals - click to copy
    3. Paste into Relevant Businesses:
      Alert 2 - Relevant Businesses - click to copy
    4. Paste into Relevant Transactions:
      Alert 2 - Relevant Transactions - click to copy
    5. Paste into AML Rule:
      Alert 2 - AML Rule - click to copy
    6. Paste into Triggering Transactions:
      Alert 2 - Triggering Transactions - click to copy
    7. Paste into Investigation Subject:
      Alert 2 - Investigation Subject - click to copy
    8. Paste into Expected Output:
      Alert 2 - Expected Output - click to copy
    9. Click Add another input variable and output set.

    Alert 3

    1. Paste into Relevant Accounts:
      Alert 3 - Relevant Accounts - click to copy
    2. Paste into Relevant Associated Individuals:
      Alert 3 - Relevant Associated Individuals - click to copy
    3. Paste into Relevant Businesses:
      Alert 3 - Relevant Businesses - click to copy
    4. Paste into Relevant Transactions:
      Alert 3 - Relevant Transactions - click to copy
    5. Paste into AML Rule:
      Alert 3 - AML Rule - click to copy
    6. Paste into Triggering Transactions:
      Alert 3 - Triggering Transactions - click to copy
    7. Paste into Investigation Subject:
      Alert 3 - Investigation Subject - click to copy
    8. Paste into Expected Output:
      Alert 3 - Expected Output - click to copy
    9. Click Add another input variable and output set.

    Alert 4

    1. Paste into Relevant Accounts:
      Alert 4 - Relevant Accounts - click to copy
    2. Paste into Relevant Associated Individuals:
      Alert 4 - Relevant Associated Individuals - click to copy
    3. Paste into Relevant Businesses:
      Alert 4 - Relevant Businesses - click to copy
    4. Paste into Relevant Transactions:
      Alert 4 - Relevant Transactions - click to copy
    5. Paste into AML Rule:
      Alert 4 - AML Rule - click to copy
    6. Paste into Triggering Transactions:
      Alert 4 - Triggering Transactions - click to copy
    7. Paste into Investigation Subject:
      Alert 4 - Investigation Subject - click to copy
    8. Paste into Expected Output:
      Alert 4 - Expected Output - click to copy
    9. Click Run Evaluation.

Action Three: Review the Results

Steps:

  1. In AI > Evaluations, find your evaluation and open it. Use the search bar if necessary.
  2. For each of the items, mouse over the context menu (the three dots) on the right and click the binoculars to view the details.
  3. Compare the model response to the expected output and choose like or dislike when appropriate.

Action Four: Update the Prompt and Test Again

Steps:

  1. Navigate to the AI Skill named AMLInvestigationDecisionandFormat in BAA > Follow the Money > Hard > Tools and open it.
  2. Update the AI Skill so that it produces a better outcome. Use this text as your starting point or use this exactly (this one works). Paste into the User Prompt of the AI Skill.:
    You are an AML investigation decisioning capability.  You will be provided information about an AML alert and the subsequent findings and you must make a determination on whether the activity is Innocuous or Supicious Activity and provide reasoning in the form of a SAR Narrative..
    
    Your job is to look at the collected material and make the determination by answering the question "Can I explain the triggering transactions?" If there's no explanation to be found, escalate as suspicious and explain the reasoning.  If you can explain it due to information about related persons or businesses or accounts, mark as innocuous and explain the reasoning.
    
    Structuring - STRUCT-001 -  A person is attempting to hide illicit behavior by structuring deposits in such a way that it avoids a Currency Transaction Report, which is required when multiple deposits summing more than $$10000 in a short period of time.
    Funneling - FUNNEL-001 - A person makes multiple deposits across potentially multiple branches and then wires most or all of the amount to an otherwise unrelated 3rd party. 
    
    Investigation material:
    
    Rule that fired and description: $AMLRule$
    Triggering Transactions: $TriggeringTransactions$
    
    The subject of the investigation is:
    $InvestigationSubject$
    
    Here are the relevant accounts:
    $RelevantAccounts$
    
    If there are any relevant, associated individuals, they are here.  
    $RelevantAssociatedIndividuals$
    
    If there are any relevant business entities, they are here:
    $RelevantBusinesses$
    
    Here are all the relevant transactions. Transactions irrelevant to the investigation were excluded from this list, meaning the entire narrative of transactional behavior is contained here.
    $RelevantTransactions$
    
    The following JSON is the required response format. Add or remove accounts, individuals, and business lookups as necessary.  Do not include text outside the JSON.  Only respond in fully form valid JSON.  Do not respond in Markdown or HTML.
    
    {"disposition": "[[must be either 'innocuous' or 'suspicious']]",
      "narrative": "[[A SAR Narrative explaining the disposition]]",
      "associated_accounts": [
        {
          "account_number": "string",
          "account_type": "string",
          "notes": "string"
        }
      ],
      "associated_individuals": [
        {
          "full_name": "string",
          "tax_id": "string",
          "reason_for_inclusion": "string"
        }
      ],
      "business_lookups": [
        {
          "business_name": "string",
          "finding": "string"}]}
    
    
    Only respond in fully form valid JSON.
    
    Tips for filling this out:
    
    Include a unique account object for every acount mentioned and identified. 
    Do not include the primary subject in the associated individuals section.
    Account Types must be one of: checking, business_checking, credit_card, home_equity_loan, personal_loan, auto_loan.
  3. Rerun the evaluation: at the top, click Evaluate, then click Run Evaluation.
  4. Provide a new name and add V2 at the end. Select Evaluate manually.
  5. Select Use existing data and pick your data set from the drop-down.
  6. Click Run evaluation.
  7. Reassess the results. The expected should be more aligned with the model response.

Action Five: Run the Process

Steps:

  1. Navigate to Bots/BAA/FollowTheMoney/Hard and open FollowtheMoneyProcess.
  2. Open the Red Flags resource link, navigate to My Profile, and copy your API Key.
  3. Back in the process, in the top right, click Run. When prompted for the input variables, paste your API Key and click Confirm.