Merge pull request selfteaching#3 from selfteaching/master

daily merge to local branch.

Author: lunbixiaozi

.vscode/launch.json

@@ -0,0 +1,25 @@
+import requests
+import yagmail
+import getpass
+from pyquery import PyQuery
+from mymodule import stats_word
+
+# 设置发件人、登录密码、收件人
+sender = input('请输入发件人邮箱地址：')
+psw = input('请输入发件人邮箱登录密码：')
+recipient = input('请输入收件人邮箱地址：')
+smtp = 'smtp.qq.com'
+
+# 访问url获取微信公众号文章
+response = requests.get('https://mp.weixin.qq.com/s/pLmuGoc4bZrMNl7MSoWgiA')
+
+# 提取微信公众号正文
+document = PyQuery (response.text)
+content = document ('#js_content').text() 
+
+# 统计前100词频
+statList = stats_word.stats_text(content,100)
+statString = ''.join(str(i) for i in statList)
+
+# 将统计结果发送到 
+yagmail.SMTP(sender,psw,smtp).send(recipient,'shawn',statString)    

.vscode/settings.json

@@ -69,4 +69,7 @@ Day10
   可在自学的过程中那些先入为主的认知会不停地跑出来。每解决一个问题都会运行一个程序，啊~原来是这样的，这么简单，你居然花了半个小时。完全就是吃到第七个烧饼饱了就忘了前六个的功劳。道理懂啊，但是多快好省地完成任务，节约时间，这些鬼东西就会干扰自己。给自己学习技能留下充足的预算，比你天真以为的很长还要长。刻意思考需要刻意练习哪些地方。过程就是这样，谁知道下一次是第几个烧饼能让你吃饱啊。看来要改诨号为慢慢来了！
   大家好，我是慢慢来！
 
-
+Day11
+  慢慢来今天要被一个问题弄死了！“from mymodule import stats_word”这行导入函数一直报错。
+  把文件目录截图给教练和战友看了，也没看出啥来。我就不再纠结了，很简单粗暴的从头来了一遍。重新建文件夹，重新写函数。这个报错就没有再出现过。也许我们是要认真分析错误的原因，但是在入门的时候，真的不妨从头再来，不怕从零开始去反复。
+  

19100101/Shawn/d11_training1.py

@@ -0,0 +1,24 @@
+# Date:19/03/28
+
+import requests
+import yagmail
+import getpass
+from pyquery import PyQuery
+from mymodule import stats_word
+
+sender = input('请输入发件人邮箱地址:')
+psw = input('请输入发件人邮箱登录密码:')
+recipient = input('请输入收件人邮箱地址:')
+smtp = 'smtp.qq.com'
+
+response = requests.get('https://mp.weixin.qq.com/s/pLmuGoc4bZrMNl7MSoWgiA')
+
+document = PyQuery (response.text)
+content = document ('#js_content').text()
+
+statList = stats_word.stats_text(content, 100)
+statString = ''.join(str(i) for i in statList)
+
+yagmail.SMTP(sender,psw,smtp).send(recipient,'19100101 WangRui0802',statString)
+
+

19100101/WangRui0802/README.md

@@ -1,58 +1,13 @@
-text = '''
-	愚公移山
-	
-	太行，王屋二山的北面，住了一個九十歲的老翁，名叫愚公。二山佔地廣闊，擋住去路，使他和家人往來極為不便。
-	
-	一天，愚公召集家人說：「讓我們各盡其力，剷平二山，開條道路，直通豫州，你們認為怎樣？」
-	大家都異口同聲贊成，只有他的妻子表示懷疑，並說：「你連開鑿一個小丘的力量都沒有，怎可能剷平太行、王屋二山呢？況且，鑿出的土石又丟到哪裏去呢？」
-	
-	大家都熱烈地說：「把土石丟進渤海裏。」
-	於是愚公就和兒孫，一起開挖土，把土石搬運到渤海去。
-	愚公的鄰居是個寡婦，有個兒子八歲也興致勃勃地走來幫忙。
-	寒來暑往，他們要一年才能往返渤海一次。
-	
-	住在黃河河畔的智叟，看見他們這樣辛苦，取笑愚公說：「你不是很愚蠢嗎？你已一把年紀了，就是用盡你的氣力，也不能挖去山的一角呢？」
-	
-	愚公歎息道：「你有這樣的成見，是不會明白的。你比那寡婦的小兒子還不如呢！就算我死了，還有我的兒子，我的孫子，我的曾孫子，他們一直傳下去。而這二山是不會加大的，總有一天，我們會把它們剷平。」
-	
-	智叟聽了，無話可說：
-	二山的守護神被愚公的堅毅精神嚇倒，便把此事奏知天帝。天帝佩服愚公的精神，就命兩位大力神揹走二山。
-	
-	How The Foolish Old Man Moved Mountains
-	
-	Yugong was a ninety-year-old man who lived at the north of two high mountains, Mount Taixing and Mount Wangwu.
-	
-	Stretching over a wide expanse of land, the mountains blocked yugong’s way making it inconvenient for him and his family to get around.
-	One day yugong gathered his family together and said,”Let’s do our best to level these two mountains. We shall open a road that leads to Yuzhou. What do you think?”
-	
-	All but his wife agreed with him.
-	“You don’t have the strength to cut even a small mound,” muttered his wife. “How on earth do you suppose you can level Mount Taixin and Mount Wanwu? Moreover, where will all the earth and rubble go?”
-	“Dump them into the Sea of Bohai!” said everyone.
-	
-	So Yugong, his sons, and his grandsons started to break up rocks and remove the earth. They transported the earth and rubble to the Sea of Bohai.
-	
-	Now Yugong’s neighbour was a widow who had an only child eight years old. Evening the young boy offered his help eagerly.
-	
-	Summer went by and winter came. It took Yugong and his crew a full year to travel back and forth once.
-	
-	On the bank of the Yellow River dwelled an old man much respected for his wisdom. When he saw their back-breaking labour, he ridiculed Yugong saying,”Aren’t you foolish, my friend? You are very old now, and with whatever remains of your waning strength, you won’t be able to remove even a corner of the mountain.”
-	
-	Yugong uttered a sigh and said,”A biased person like you will never understand. You can’t even compare with the widow’s little boy!”
-	
-	“Even if I were dead, there will still be my children, my grandchildren, my great grandchildren, my great great grandchildren. They descendants will go on forever. But these mountains will not grow any taler. We shall level them one day!” he declared with confidence.
-	
-	The wise old man was totally silenced.
-	When the guardian gods of the mountains saw how determined Yugong and his crew were, they were struck with fear and reported the incident to the Emperor of Heavens.
-	
-	Filled with admiration for Yugong, the Emperor of Heavens ordered two mighty gods to carry the mountains away.
-	'''
-
-with open('tang300.json') as t:
-	read_file = t.read()
+with open('tang300.json') as t :
+    ''' 1. 导入json文件并读取文件内容'''
+    read_file = t.read()
 t.closed
 
-from mymodule import stats_word #导入stats_word模块
-try:
-    print('Top20中文词频统计结果:', stats_word.stats_text_cn(read_file, 20)) 
-except ValueError as a :
-    print(a)
+from mymodule import stats_word
+''' 1. 捕获传入非字符串参数异常。
+    2. 调用stats_word.py中的stats_text_cn(),传入读取文件结果和输出限制参数。
+'''
+try : 
+    print('Top20中文词频统计结果： ', stats_word.stats_text_cn(read_file,20))
+except ValueError as ve :
+    print(ve)

19100101/WangRui0802/d11_training1.py

@@ -1,73 +1,46 @@
-# 一个中英混杂的文本
-str = '''
-The Zen of Python, by Tim Peters
-
-
-Beautiful is better than ugly.
-Explicit is better than implicit.
-Simple is better than complex.
-Complex is better than complicated.
-Flat is better than nested.
-Sparse is better than dense.
-Readability counts.
-Special cases aren't special enough to break the rules.
-Although practicality beats purity.
-Errors should never pass silently.
-Unless explicitly silenced.
-In the face of ambxiguity, refuse the temptation to guess.
-There should be one-- and preferably only one --obvious way to do it.
-Although that way may not be obvious at first unless you're Dutch.
-Now is better than never.
-Although never is often better than *right* now.
-If the implementation is hard to explain, it's a bad idea.
-If the implementation is easy to explain, it may be a good idea.
-Namespaces are one honking great idea -- let's do more of those!
-Python是一种计算机程序设计语言。是一种动态的、面向对象的脚本语言，最初被设计用于编写自动化脚本(shell)，随着版本的不断更新和语言新功能的添加，越来越多被用于独立的、大型项目的开发。
-'''
-
 import collections
 import re
 import jieba
-    
-def stats_text_en(en,count):
-    ''' 1. 英文词频统计。
+
+def stats_text_en(en,count) :
+    ''' 1. 英文词频统计：使用正则表达式过滤英文字符，使用Counter统计并排序。
         2. 参数类型检查，不为字符串抛出异常。
     '''
-    if type(en) == str: 
-            text_en = re.sub("[^A-Za-z]", " ", text_en.strip())
+    if type(en) == str : 
+            text_en = re.sub("[^A-Za-z]", " ", en.strip())
             enList = text_en.split( )
             return collections.Counter(enList).most_common(count)
-    else:
-        
-            raise ValueError('it is not str')
-    
-def stats_text_cn(cn,count):
-    ''' 1. 汉字字频统计 
-        2. 参数类型检查，不为字符串抛出异常。
+    else : 
+            raise ValueError ('type of argumengt is not str')
+
+def stats_text_cn(cn,count) :
+    ''' 1. 使用jieba第三方库精确模式分词。
+        2. 使用正则表达式过滤汉字字符。
+        3. 使用for循环判断分词后词频列表元素长度大于等于2的生成新列表。
+        4. 使用标准库collections.Counter()统计词频并限制统计数量。 
+        5. 参数类型检查，不为字符串抛出异常。
     '''
     if type(cn) == str : 
-            cnList = re.findall(u'[\u4e00-\u9fff]+', text_cn.strip())
+            cnList = re.findall(u'[\u4e00-\u9fff]+', cn.strip())
             cnString = ''.join(cnList)
-            segList = jieba.cut(cnString, cut_all=False)
+            segList = jieba.cut(cnString,cut_all=False)
             cnnewList = []
-            for i in segList:
-                    if len(i) >= 2
-                        cnnewList.append(i)
-                    else:
-                            pass
-            countList = collections.Counter(newString).most_common(count)
+            for i in segList :
+                    if len(i) >= 2 :
+                            cnnewList.append(i)
+                    else :
+                            pass                
+            countList = collections.Counter(cnnewList).most_common(count)
             return countList
-    else:
-        
-            raise ValueError ('it is not str')
-    
+    else :
+            raise ValueError ('type of argumengt is not str')
+
 def stats_text(text_en_cn,count_en_cn) :
-    ''' 1. 合并英汉词频统计 
+    ''' 1. 合并英汉词频统计：调用stats_text_en()和stats_text_cn()并合并其结果。
         2. 参数类型检查，不为字符串抛出异常。
     '''
-    if type(text_en_cn) == str: 
+    if type(text_en_cn) == str : 
             return (stats_text_en(text_en_cn,count_en_cn)+stats_text_cn(text_en_cn,count_en_cn))
-    else:
-        
-            raise ValueError ('it is not str')
-    
+    else :
+            raise ValueError ('type of argumengt is not str')
+

19100101/WangRui0802/main.py

@@ -0,0 +1,25 @@
+'''这是一个通过网络请求获得网页内容，使用分词工具对中文字符串
+进行分词，统计词频，得出结果，并发送到指定邮箱的程序'''
+import requests
+import pyquery
+from pyquery import PyQuery
+from mymodule import stats_word
+
+'''访问网址'''
+image_url = "https://mp.weixin.qq.com/s/pLmuGoc4bZrMNl7MSoWgiA"
+'''将网址中的内容全部赋值给response'''
+response = requests.get(image_url)
+'''提取网址中的正文内容'''
+document = pyquery.PyQuery(response.text)
+content = document('#js_content').text()
+import getpass
+sender = input('输入发件人邮箱：')
+password = getpass.getpass('输入发件人邮箱密码（可复制粘贴）：')
+recipients = input('输入收件人邮箱：')
+
+import yagmail
+
+yag = yagmail.SMTP(user=sender,password=password,host='smtp.163.com')
+contents = [stats_word.stats_text_cn(content,100)]
+yag.send(recipients,'主题：张小龙微信公开课演讲稿中文词频前100名统计',contents)
+

19100101/WangRui0802/mymodule/stats_word.py

@@ -0,0 +1,19 @@
+import requests
+import yagmail
+import getpass
+from pyquery import PyQuery 
+from mymodule import stats_word
+
+image_url = "https://mp.weixin.qq.com/s/pLmuGoc4bZrMNl7MSoWgiA"
+response = requests.get(image_url)
+document = PyQuery(response.text)
+content = document('#js_content').text()
+ 
+sender = input('输入发件人邮箱地址：')
+password = getpass.getpass('输入发件人邮箱密码（可复制粘贴）：')
+recipient = input('输入收件人邮箱地址：')
+
+
+yag = yagmail.SMTP(user=sender,password=password,host='smtp.qq.com')
+content = [stats_word.stats_text_cn(content,100)]
+yag.send(recipient,'lidong2119 d11',content)

19100101/YanHuiii/d11_training1.py

@@ -1,3 +1,7 @@
+2019.3.28
+1. learn to use 3rd-party library "requests","yagmail","pyquery".
+2. use "requests" to get information from a url, get the content, cut the words and email them.
+
 2019.3.27
 1. learn to use conda to install 3rd-party library "jieba".
 2. use "jieba" to cut string into words.

19100101/lidong2119/d11_training1.py

@@ -0,0 +1,29 @@
+# this is d11 excercise for 3rd-party library yagmail,requests,pyquery
+# date : 2019.3.28
+# author by : qiming
+
+import requests
+import yagmail
+import getpass
+from pyquery import PyQuery
+from mymodule import stats_word
+
+# 设置发件人、登录密码、收件人
+sender = input('请输入发件人邮箱地址：')
+psw = input('请输入发件人邮箱登录密码：')
+recipient = input('请输入收件人邮箱地址：')
+smtp = 'smtp.163.com'
+
+# 访问url获取微信公众号文章
+response = requests.get('https://mp.weixin.qq.com/s/pLmuGoc4bZrMNl7MSoWgiA')
+
+# 提取微信公众号正文
+document = PyQuery (response.text)
+content = document ('#js_content').text() 
+
+# 统计前100词频
+statList = stats_word.stats_text(content,100)
+statString = ''.join(str(i) for i in statList)
+
+# 将统计结果发送到 [email protected]，title: 19100101 qiming
+yagmail.SMTP(sender,psw,smtp).send(recipient,'19100101 qiming',statString)