botiverse.Theorizer package

Subpackages

• botiverse.Theorizer.model package
  • Submodules
  • botiverse.Theorizer.model.dataloader module
    • SquadGPT2Example
      • SquadGPT2Example.input_ids
      • SquadGPT2Example.attention_mask
      • SquadGPT2Example.token_type_ids
      • SquadGPT2Example.lm_labels
    • prepare_squad_data_for_gpt2()
    • prepare_and_pad_squad_data_for_gpt2()
    • from_dict_to_squad_processed_example()
    • read_cached_processed_examples()
    • test_getdataset()
    • test_tokenizer()
    • prepare_squad_for_gpt2()
  • botiverse.Theorizer.model.finetuned_model module
    • MyGPT2LMHeadModel
      • MyGPT2LMHeadModel.get_output_embeddings()
      • MyGPT2LMHeadModel.set_output_embeddings()
      • MyGPT2LMHeadModel.prepare_inputs_for_generation()
      • MyGPT2LMHeadModel.forward()
      • MyGPT2LMHeadModel.training
  • botiverse.Theorizer.model.train module
  • botiverse.Theorizer.model.utils module
    • get_overlap_position()
    • pad_dataset()
  • Module contents
• botiverse.Theorizer.squad package
  • Submodules
  • botiverse.Theorizer.squad.info_extractor module
    • ClueInfo
      • ClueInfo.clue_pos_tag
      • ClueInfo.clue_ner_tag
      • ClueInfo.clue_length
      • ClueInfo.clue_chunk
      • ClueInfo.clue_answer_dep_path_len
      • ClueInfo.padded_selected_clue_binary_ids
    • SquadAugmentedExample
      • SquadAugmentedExample.context_text
      • SquadAugmentedExample.question_text
      • SquadAugmentedExample.answer_text
      • SquadAugmentedExample.question_type
      • SquadAugmentedExample.answer_pos_tag
      • SquadAugmentedExample.answer_ner_tag
      • SquadAugmentedExample.answer_length
      • SquadAugmentedExample.clue_info
    • chunks()
    • get_dependency_paths()
    • extract_clue()
    • extract_question_type_and_id()
    • extract_clue_and_question_info()
    • test_chunks()
    • test_extract_clue()
    • test_extract_question_type()
    • test_extract_clue_and_question_info()
  • botiverse.Theorizer.squad.sample_data module
    • AnswerSample
      • AnswerSample.answer_text
      • AnswerSample.char_st
      • AnswerSample.char_ed
      • AnswerSample.st
      • AnswerSample.ed
      • AnswerSample.answer_bio_ids
      • AnswerSample.answer_pos_tag
      • AnswerSample.answer_ner_tag
    • ClueSample
      • ClueSample.clue_text
      • ClueSample.clue_binary_ids
    • select_answers()
    • select_questions()
    • select_clues()
    • select()
    • read_sample_probs()
    • select_with_default_sampel_probs()
    • test()
  • botiverse.Theorizer.squad.squad_example module
    • SquadExample
      • SquadExample.context_text
      • SquadExample.question_text
      • SquadExample.answer_text
      • SquadExample.answer_start
    • SquadProcessedExample
      • SquadProcessedExample.context_text
      • SquadProcessedExample.question_text
      • SquadProcessedExample.question_type
      • SquadProcessedExample.answer_text
      • SquadProcessedExample.answer_start
      • SquadProcessedExample.clue_text
      • SquadProcessedExample.clue_start
      • SquadProcessedExample.para_id
    • read_squad_examples()
    • create_squad_example_with_info()
    • calculate_probability_distribution()
    • create_process_squad_examples()
    • pipeline()
  • botiverse.Theorizer.squad.utils module
    • SpacyDoc
    • SpacyToken
    • InfoConfig
      • InfoConfig.num_sample_style
      • InfoConfig.num_sample_answer
      • InfoConfig.ans_len_bin_width
      • InfoConfig.ans_len_min_val
      • InfoConfig.ans_len_max_val
      • InfoConfig.ans_limit
      • InfoConfig.num_sample_clue
      • InfoConfig.is_clue_topN
      • InfoConfig.clue_dep_dist_bin_width
      • InfoConfig.clue_dep_dist_min_val
      • InfoConfig.clue_dep_dist_max_val
      • InfoConfig.ques_limit
      • InfoConfig.sent_limit
      • InfoConfig.max_sample_times
    • find_token_spans_in_text()
    • match_spans()
    • normalize()
    • token_to_char_indices()
    • weighted_sample()
    • value_to_bin()
    • str_find()
    • test_find_token_spans_in_text()
    • test_match_spans()
  • Module contents

Submodules

botiverse.Theorizer.Theorizer module

botiverse.Theorizer.constants module

Common constants

botiverse.Theorizer.generate module

botiverse.Theorizer.generate.generate(context, max_length=50)

Module contents