[人工智能]TensorFlow by Google #10使用 NLP 构建讽刺分类器 Using NLP to build a sarcasm classifier

• https://rishabhmisra.gihub.io/publications/
• 二维码的链接 https://www.kaggle.com/rmisra/news-headlines-dataset-for-sarcasm-detection

练习1

https://bit.ly/tfw-nlpsarcasm

!wget --no-check-certificate \
    https://storage.googleapis.com/laurencemoroney-blog.appspot.com/sarcasm.json \
    -O /tmp/sarcasm.json
  
import json

with open("/tmp/sarcasm.json", 'r') as f:
    datastore = json.load(f)


sentences = [] 
labels = []
urls = []
for item in datastore:
    sentences.append(item['headline'])
    labels.append(item['is_sarcastic'])
    urls.append(item['article_link'])



from tensorflow.keras.preprocessing.text import Tokenizer
from tensorflow.keras.preprocessing.sequence import pad_sequences
tokenizer = Tokenizer(oov_token="<OOV>")
tokenizer.fit_on_texts(sentences)

word_index = tokenizer.word_index
print(len(word_index))
print(word_index)
sequences = tokenizer.texts_to_sequences(sentences)
padded = pad_sequences(sequences, padding='post')
print(padded[0])
print(padded.shape)

练习2

• https://bit.ly/tfw-sarcembed
• https://projector.tensorflow.org/

参考

https://youtu.be/-8XmD2zsFBI