Shu Wu

Generating unbreakable password ?

Aug.24,2015

Last day when I was busy learning the SAS and R in the workshop provided by MSBA program in USC, I thought a lot about my next python program. All the program I wrote are driven by my interest in python, so until I found something interesting again, I would hardly write something notable.

I came across a post on http://www.williamlong.info/archives/3224.html, which inspired this short program. Unfortunately it was written in Chinese and the main idea is about the security of your password. To sum up, there are a lot of encryption rules and most of them are related to MD5(Message-Digest Algorithm), which generates hash value. However, due to the fast-growing technology, MD5-generated code could also be hacked using super computers. Many others would recommend a newer algorithm but in my opinion the hacking is a matter of time.

Therefore, what I am going to do is to enhance the difficulty of password hacking. I am going to give the password a random shuffle and a for loop to increase the complexity and time for breaking. Here is my simple idea:

import hashlib
from random import shuffle

def MD5_parser(pwd_1, number):
	new_md5 = hashlib.md5()
	count = 0
	full_md5 = ''
	while count < number:
		for i in pwd_1:
			new_md5.update(i)
			# print new_md5.hexdigest
			full_md5 += str(new_md5.hexdigest())
		pwd_1 = full_md5
		full_md5 = ''
		count += 1
	return pwd_1

def shuffle_password(pwd):
	b = []
	for i in pwd:
		b.append(i)
	shuffle(b)
	pwd_1 = ''.join(b)
	print 'Your password after shuffle is ' + pwd_1 + '\n'
	return pwd_1


def main():
	# raw_input returns a str
	number = int(raw_input('How many times do you want your password to be envrypted: '))
	pwd = raw_input('Enter your password here: ')
	pwd_1 = shuffle_password(pwd)
	final_MD5 = MD5_parser(pwd_1, number)
	print final_MD5

if __name__ == '__main__':
	main()

import hashlib

from random import shuffle

def MD5_parser(pwd_1, number):

new_md5 = hashlib.md5()

count = 0

full_md5 = ''

while count < number:

for i in pwd_1:

new_md5.update(i)

# print new_md5.hexdigest

full_md5 += str(new_md5.hexdigest())

pwd_1 = full_md5

full_md5 = ''

count += 1

return pwd_1

def shuffle_password(pwd):

b = []

for i in pwd:

b.append(i)

shuffle(b)

pwd_1 = ''.join(b)

print 'Your password after shuffle is ' + pwd_1 + '\n'

return pwd_1

def main():

# raw_input returns a str

number = int(raw_input('How many times do you want your password to be envrypted: '))

pwd = raw_input('Enter your password here: ')

pwd_1 = shuffle_password(pwd)

final_MD5 = MD5_parser(pwd_1, number)

print final_MD5

if __name__ == '__main__':

main()

During this example I found out that Sublime Text 3 surprisingly did not support “raw_input” function because it could not pop out a window for users to input the strings. It makes ST3 so annoying that I have to have terminal active all the time.

Overall, I don’t think there’s any kind of password that is unbreakable so security should be well considered every time you store it at some place. What’s more, we need to increase the time and cost for hacking, and also lower the value of breaking our password. Protect yourself on the Internet!

Jikexueyuan Spider

Aug.10,2015

www.jikexueyuan.com is one of my favorite websites to study coding on my own. One of its biggest advantages is the lessons are relatively short compared to long and boring lessons on some websites. However, the UI of jikexueyuan.com has drawbacks in showing learner the connection between different classes. For example, I want to study HTML and CSS, but I cannot filter by lecturers or by time added, so that it is extremely hard to find out the correct sequence after this class(time added is only available in the course’s main page, not on the index page). What I could ONLY do is to select a specific category such as HTML, and face a number of unordered courses, making me frustrated which one to go after this course.

Therefore, I would like to design an application to retrieve all the related courses under a specific category, and automatically click the URL of each course in the background, and then retrieve the name and time added of each course. Finally, I want it to sort the course by time added and write the information down on a .txt file so that I can analyze conveniently. Here are the codes:

#coding=utf-8

from bs4 import BeautifulSoup
import re
import urllib2
import time
import json
import os
import sys

reload(sys)
sys.setdefaultencoding('utf8')

class See_Course_History(object):
	"""docstring for See_Course_History
       this application is designed to see all of the course
       names and dates added to the "www.jikexueyuan.com"
	"""
	def __init__(self, website='http://www.jikexueyuan.com/course/web/', pageNum=11):
		super(See_Course_History, self).__init__()
		self.website = website
		self.pageNum = pageNum

	def Htmlparser(self):
		print 'I am retrieving the .html files of all pages under this category'
		global emptybox
		emptybox = []
		for i in xrange(1, self.pageNum+1):
			url = urllib2.urlopen(self.website+'?pageNum=' + str(i))
			soup = BeautifulSoup(url)
			lesson_list = soup.find_all(class_ = 'lesson-info-h2')
			emptybox += lesson_list

	def get_page_urls(self):
		global urlbox
		self.Htmlparser()
		print 'I am working hard to get the urls on the .html files'
		urlbox_string = []
		for i in emptybox:
			i = str(i)
			urlbox_string.append(i)
		urlbox_string = ','.join(urlbox_string)
		# print urlbox_string
		urlbox = re.findall(r'href=\"(.*?)\"', urlbox_string)
		
	def write_urls(self):
		"""
			write urls to a txt file. This is for saving the time
			when we use get_course_info method later, without having
			to connect to websites to get urls again.
		"""
		self.get_page_urls()
		file = open('../desktop/page_urls.txt','w')
		for i in urlbox:
			file.write(i+'\n')
		file.close()
		print 'I have successfully finished writing the document. Now you can check it.'
	
	def get_course_info(self):
		print 'I am scanning and connecting all the urls in the document...It might take some time.'
		file = open('../desktop/page_urls.txt','r')
		b = file.read()
		b = b.rstrip()
		urlbox2 = str(b).split('\n')
		d = {}
		for i in urlbox2:
			url = urllib2.urlopen(i)
			soup = BeautifulSoup(url)
			info = soup.find_all(class_='bc-box')
			for a in info:
				d[a.h2.string] = a.div.span.next.next.string
		# print json.dumps(d,ensure_ascii=False,encoding='UTF-8')
		d = sorted(d.iteritems(), key=lambda d:d[1], reverse = False )
		# output = json.dumps(d,ensure_ascii=False,encoding='UTF-8')

		file = open('../desktop/courses_info.txt','w')
		for i in d:
			file.write(i[0] + '  ' + i[1] + '\n')
		file.close()
		print 'All work is done. You can see the courses_info.txt right now'

if __name__ == '__main__':
	a1 = See_Course_History()
	filename = r'../desktop/page_urls.txt'
	if os.path.exists(filename):
		pass
	else:
		a1.write_urls()
	time.sleep(3)
	a1.get_course_info()

#coding=utf-8

from bs4 import BeautifulSoup

import re

import urllib2

import time

import json

import os

import sys

reload(sys)

sys.setdefaultencoding('utf8')

class See_Course_History(object):

"""docstring for See_Course_History

this application is designed to see all of the course

names and dates added to the "www.jikexueyuan.com"

"""

def __init__(self, website='http://www.jikexueyuan.com/course/web/', pageNum=11):

super(See_Course_History, self).__init__()

self.website = website

self.pageNum = pageNum

def Htmlparser(self):

print 'I am retrieving the .html files of all pages under this category'

global emptybox

emptybox = []

for i in xrange(1, self.pageNum+1):

url = urllib2.urlopen(self.website+'?pageNum=' + str(i))

soup = BeautifulSoup(url)

lesson_list = soup.find_all(class_ = 'lesson-info-h2')

emptybox += lesson_list

def get_page_urls(self):

global urlbox

self.Htmlparser()

print 'I am working hard to get the urls on the .html files'

urlbox_string = []

for i in emptybox:

i = str(i)

urlbox_string.append(i)

urlbox_string = ','.join(urlbox_string)

# print urlbox_string

urlbox = re.findall(r'href=\"(.*?)\"', urlbox_string)

def write_urls(self):

"""

write urls to a txt file. This is for saving the time

when we use get_course_info method later, without having

to connect to websites to get urls again.

"""

self.get_page_urls()

file = open('../desktop/page_urls.txt','w')

for i in urlbox:

file.write(i+'\n')

file.close()

print 'I have successfully finished writing the document. Now you can check it.'

def get_course_info(self):

print 'I am scanning and connecting all the urls in the document...It might take some time.'

file = open('../desktop/page_urls.txt','r')

b = file.read()

b = b.rstrip()

urlbox2 = str(b).split('\n')

d = {}

for i in urlbox2:

url = urllib2.urlopen(i)

soup = BeautifulSoup(url)

info = soup.find_all(class_='bc-box')

for a in info:

d[a.h2.string] = a.div.span.next.next.string

# print json.dumps(d,ensure_ascii=False,encoding='UTF-8')

d = sorted(d.iteritems(), key=lambda d:d[1], reverse = False )

# output = json.dumps(d,ensure_ascii=False,encoding='UTF-8')

file = open('../desktop/courses_info.txt','w')

for i in d:

file.write(i[0] + ' ' + i[1] + '\n')

file.close()

print 'All work is done. You can see the courses_info.txt right now'

if __name__ == '__main__':

a1 = See_Course_History()

filename = r'../desktop/page_urls.txt'

if os.path.exists(filename):

pass

else:

a1.write_urls()

time.sleep(3)

a1.get_course_info()

Use python to check my email inboxes

Aug.7,2015

Last month I came across an idea to check my email inboxes using python. I did some research on the web and try to imitate the great solutions from other coders. Because I am currently using IMAP service in my main email accounts, I chose to use the “imaplib” module to achieve my expectation. Here are the codes:

#!/usr/bin/python

#-*- encoding: utf-8 -*-

import imaplib
import re


def gmail_checker(mailhost, username, password, flag = 0):
	i=imaplib.IMAP4_SSL(mailhost)
	try:
		i.login(username, password)
		x, y=i.status('INBOX', '(MESSAGES UNSEEN)')
		messages=int(re.search('MESSAGES\s+(\d+)', y[0]).group(1))
		unseen=int(re.search('UNSEEN\s+(\d+)', y[0]).group(1))
		print "-------------------------------------------------"
		print "%s : total %i messages, %i unseen." % (username, messages, unseen)

				
	finally:
		i.logout()

if __name__ == '__main__':
	gmail_checker('imap.163.com', 'xxxx@163.com', 'xxxx', 1)
	gmail_checker('imap.qq.com','xxx@qq.com','xxx',1)
	gmail_checker('imap.gmail.com', 'xxx@gmail.com', 'xxx',1)
	gmail_checker('imap-mail.outlook.com', 'flyws1993@hotmail.com','xxx', 1)

#!/usr/bin/python

#-*- encoding: utf-8 -*-

import imaplib

import re

def gmail_checker(mailhost, username, password, flag = 0):

i=imaplib.IMAP4_SSL(mailhost)

try:

i.login(username, password)

x, y=i.status('INBOX', '(MESSAGES UNSEEN)')

messages=int(re.search('MESSAGES\s+(\d+)', y[0]).group(1))

unseen=int(re.search('UNSEEN\s+(\d+)', y[0]).group(1))

print "-------------------------------------------------"

print "%s : total %i messages, %i unseen." % (username, messages, unseen)

finally:

i.logout()

if __name__ == '__main__':

gmail_checker('imap.163.com', 'xxxx@163.com', 'xxxx', 1)

gmail_checker('imap.qq.com','xxx@qq.com','xxx',1)

gmail_checker('imap.gmail.com', 'xxx@gmail.com', 'xxx',1)

gmail_checker('imap-mail.outlook.com', 'flyws1993@hotmail.com','xxx', 1)

I needed this to help me because in China is kind of difficult to check my Gmail account and I want a simpler way to check my inboxes without opening bulkier email clients.

My First Python Application

Aug.4,2015

It’s been two months since I started learning python on my own. It all starts from the bottom of my heart, about what I really want to learn. To be honest, I genuinely feel that I’ve enjoyed this journey.

After reading related books and videos for quite a long time, I decided to get hands on the practice, which is more difficult as expected.

What drives me to write this small application is that I love watching sports games and I often checked a website, which is “www.zhibo8.cc”, to see what games are on live today. However, I found this action repetitive and a waste of time opening my website, selecting the bookmark and then scrolling down to the part which I want. I have tried several modules for web scraping and this time I chose to use BeautifulSoup to get the web page. Therefore, this module’s code is as follows:

from bs4 import BeautifulSoup
import urllib2
from datetime import *
import time
import re
import sys
reload(sys)
sys.setdefaultencoding('utf8')

url = 'http://www.zhibo8.cc/'
q = urllib2.urlopen(url)
soup = BeautifulSoup(q)

i = date.today()
today = soup.find(title=i)
#today1 = soup.find_all(class_='content')
#for i in today1:
#    print i.li
today1 = today.next.next.next.next
for i in today1.ul:
    if i.next.string == None:
        pass
    else:
        print i.next.string + '\n' + i.next.next.string
        print '-'*30

from bs4 import BeautifulSoup

import urllib2

from datetime import *

import time

import re

import sys

reload(sys)

sys.setdefaultencoding('utf8')

url = 'http://www.zhibo8.cc/'

q = urllib2.urlopen(url)

soup = BeautifulSoup(q)

i = date.today()

today = soup.find(title=i)

#today1 = soup.find_all(class_='content')

#for i in today1:

# print i.li

today1 = today.next.next.next.next

for i in today1.ul:

if i.next.string == None:

pass

else:

print i.next.string + '\n' + i.next.next.string

print '-'*30

It works pretty well and shows me what I need in the console. But after I came to the U.S., it started to raise an error saying the variable “today” is Nonetype. After debugging, I found it kind of funny because it is due to the time zone difference. Variable “i” here represents today in the U.S. while sometimes in China it is one day later. Obviously, the website “zhibo8” will delete all the live games information at the end of the day. So if I am lucky enough to run this application at night in Los Angeles, when it is tomorrow morning in China, I will encounter this error.

I plan to figure out a way to solve this problem later, and I am quite satisfied with my first executable python file after two months.

Previous 1 2 3 4 5

M	T	W	T	F	S	S
« May
					1	2
3	4	5	6	7	8	9
10	11	12	13	14	15	16
17	18	19	20	21	22	23
24	25	26	27	28	29	30

Generating unbreakable password ?

Jikexueyuan Spider

Use python to check my email inboxes

My First Python Application

About me

Categories

Meta