diff --git "a/\133Master\135Fine_Tune_BERT_for_Text_Classification_with_TensorFlow.ipynb" "b/\133Master\135Fine_Tune_BERT_for_Text_Classification_with_TensorFlow.ipynb" new file mode 100644 index 0000000..36e3f4c --- /dev/null +++ "b/\133Master\135Fine_Tune_BERT_for_Text_Classification_with_TensorFlow.ipynb" @@ -0,0 +1,1375 @@ +{ + "nbformat": 4, + "nbformat_minor": 0, + "metadata": { + "colab": { + "name": "[Master]Fine-Tune-BERT-for-Text-Classification-with-TensorFlow.ipynb", + "provenance": [], + "collapsed_sections": [], + "machine_shape": "hm" + }, + "kernelspec": { + "name": "python3", + "display_name": "Python 3" + }, + "accelerator": "GPU" + }, + "cells": [ + { + "cell_type": "markdown", + "metadata": { + "id": "zGCJYkQj_Uu2" + }, + "source": [ + "
Figure 1: BERT Classification Model
\n", + "\n", + " | qid | \n", + "question_text | \n", + "target | \n", + "
---|---|---|---|
1306102 | \n", + "ffff3778790af9baae76 | \n", + "What steps can I take to live a normal life if... | \n", + "0 | \n", + "
1306103 | \n", + "ffff3f0a2449ffe4b9ff | \n", + "Isn't Trump right after all? Why should the US... | \n", + "1 | \n", + "
1306104 | \n", + "ffff41393389d4206066 | \n", + "Is 33 too late for a career in creative advert... | \n", + "0 | \n", + "
1306105 | \n", + "ffff42493fc203cd9532 | \n", + "What is difference between the filteration wor... | \n", + "0 | \n", + "
1306106 | \n", + "ffff48dd47bee89fff79 | \n", + "If the universe \"popped\" into existence from n... | \n", + "0 | \n", + "
1306107 | \n", + "ffff5fd051a032f32a39 | \n", + "How does a shared service technology team meas... | \n", + "0 | \n", + "
1306108 | \n", + "ffff6d528040d3888b93 | \n", + "How is DSATM civil engineering? | \n", + "0 | \n", + "
1306109 | \n", + "ffff8776cd30cdc8d7f8 | \n", + "Do you know any problem that depends solely on... | \n", + "0 | \n", + "
1306110 | \n", + "ffff94d427ade3716cd1 | \n", + "What are some comic ideas for you Tube videos ... | \n", + "0 | \n", + "
1306111 | \n", + "ffffa382c58368071dc9 | \n", + "If you had $10 million of Bitcoin, could you s... | \n", + "0 | \n", + "
1306112 | \n", + "ffffa5b0fa76431c063f | \n", + "Are you ashamed of being an Indian? | \n", + "1 | \n", + "
1306113 | \n", + "ffffae5dbda3dc9e9771 | \n", + "What are the methods to determine fossil ages ... | \n", + "0 | \n", + "
1306114 | \n", + "ffffba7c4888798571c1 | \n", + "What is your story today? | \n", + "0 | \n", + "
1306115 | \n", + "ffffc0c7158658a06fd9 | \n", + "How do I consume 150 gms protein daily both ve... | \n", + "0 | \n", + "
1306116 | \n", + "ffffc404da586ac5a08f | \n", + "What are the good career options for a msc che... | \n", + "0 | \n", + "
1306117 | \n", + "ffffcc4e2331aaf1e41e | \n", + "What other technical skills do you need as a c... | \n", + "0 | \n", + "
1306118 | \n", + "ffffd431801e5a2f4861 | \n", + "Does MS in ECE have good job prospects in USA ... | \n", + "0 | \n", + "
1306119 | \n", + "ffffd48fb36b63db010c | \n", + "Is foam insulation toxic? | \n", + "0 | \n", + "
1306120 | \n", + "ffffec519fa37cf60c78 | \n", + "How can one start a research project based on ... | \n", + "0 | \n", + "
1306121 | \n", + "ffffed09fedb5088744a | \n", + "Who wins in a battle between a Wolverine and a... | \n", + "0 | \n", + "
Figure 2: BERT Tokenizer
\n", + "Figure 3: BERT Layer
\n", + "