原文
这篇文章主要介绍了使用Python脚本操作MongoDB的教程,MongoDB作为非关系型数据库得到了很大的宣传力度,而市面上的教程一般都是讲解JavaScript的脚本操作,本文则是基于Python,需要的朋友可以参考下
0.启动mongodb数据库 $mongod.exe--dbpathD:\mongodb\data\db 1.连接数据库MongoClientVSConnection
classMongoClient(pymongo.common.BaseObject)
|ConnectiontoMongoDB.
|
|Methodresolutionorder:
|MongoClient
|pymongo.common.BaseObject
|builtin.object
|classConnection(pymongo.mongo_client.MongoClient)
|ConnectiontoMongoDB.
|
|Methodresolutionorder:
|Connection
|pymongo.mongo_client.MongoClient
|pymongo.common.BaseObject
|builtin.object从这两个类的继承来看,connection是继承了MongoClient的,建议使用MongoClient而不是使用Connection。(也就是说,MongoClient可以使用方法Connection都可以使用)
frompymongoimportMongoClient client=MongoClient(192.168.40.87,27037) db_name=TCL_Useraction db=client[db_name] collection_useraction=db[useraction]这里是通过字典的方式访问数据库和集合,同时你也可以通过.(点号)的方式访问
2.插入数据save()VSinsert()
mongodb的save和insert函数都可以向collection里插入数据,但两者是有两个区别:
一、save函数实际就是根据参数条件,调用了insert或update函数.如果想插入的数据对象存在,insert函数会报错,而save函数是改变原来的对象;如果想插入的对象不存在,那么它们执行相同的插入操作.这里可以用几个字来概括它们两的区别,即所谓"有则改之,无则加之".
二、insert可以一次性插入一个列表,而不用遍历,效率高,save则需要遍历列表,一个个插入。
3.更新数据对于单个数据来说,可以更新后使用save方法
update(criteria,objNew,upsert,mult)
criteria:需要被更新的条件表达式
objNew:更新表达式
upsert:如目标记录不存在,是否插入新文档。
multi:是否更新多个文档。
collection_useraction.update({gid:last_gid,time:l_date}, {$set:{gid:last_gid}, $set:{time:l_date}, $addToSet:{categories:category_data}}, upsert=True)
4.删除数据 db.users.drop()#删除集合 #remove(self,spec_or_id=None,safe=None,multi=True,**kwargs) #remove()用于删除单个或全部文档,删除后的文档无法恢复。 id=db.users.find_one({"name":"user2"})["_id"] db.users.remove(id)#根据id删除一条记录 db.users.remove()#删除集合里的所有记录 db.users.remove({yy:5})#删除yy=5的记录 5.查询 #查询age小于15的 foruindb.users.find({"age":{"$lt":15}}): print(u) 5.1查询一条记录 #查询name等于user8的 foruindb.users.find({"name":"user8"}): print(u) #获取查询的一个 u2=db.users.find_one({"name":"user9"})#查不到时返回None print(u2) 5.2查询特定键(fields)特别说明
:
在3.0版本中,这个参数已经改名为projection,若用fields会报错 #selectname,agefromuserswhereage=21 foruindb.users.find({"age":21},["name","age"]): print(u) foruindb.users.find(fields=["name","age"]): print(u) 5.3排序(SORT) pymongo.ASCENDING#也可以用1来代替 pymongo.DESCENDING#也可以用-1来代替 foruindb.users.find().sort([("age",pymongo.ASCENDING)]): print(u)#select*from集合名orderby键1 foruindb.users.find().sort([("age",pymongo.DESCENDING)]): print(u)#select*from集合名orderby键1desc foruindb.users.find().sort([("键1",pymongo.ASCENDING),("键2",pymongo.DESCENDING)]): print(u)#select*from集合名orderby键1asc,键2desc foruindb.users.find(sort=[("键1",pymongo.ASCENDING),("键2",pymongo.DESCENDING)]): print(u)#sort的另一种写法 foruindb.users.find({"name":"user9"},sort=[[name,1],[sex,1]],fields=["name","age",sex]): print(u)#组合写法 5.4从第几行开始读取(SLICE),读取多少行(LIMIT) #select*from集合名skip2limit3 #MySQL的写法:select*from集合名limit2,3 foruindb.users.find().skip(2).limit(3): print(u) foruindb.users.find(skip=2,limit=3): print(u) #可以用切片代替skip&limit(mongo中的$slice貌似有点问题)。 foruindb.users.find()[2:5]: print(u) #单独的写 foruindb.users.find().skip(2): print(u) foruindb.users.find(skip=1): print(u) foruindb.users.find().limit(5): print(u) foruindb.users.find(limit=3): print(u) 5.5多条件查询(ConditionalOperators)#like的可使用正则表达式查询 #select*fromuserswherename=user3andage>12andage<15 foruindb.users.find({age:{$gt:12,$lt:15},name:user3}): print(u) #select*fromuserswherename=user1andage=21 foruindb.users.find({"age":21,"name":"user1"}): print(u) 5.6IN foruindb.users.find({"age":{"$in":(23,26,32)}}): print(u)#select*fromuserswhereagein(23,26,32) foruindb.users.find({"age":{"$nin":(23,26,32)}}): print(u)#select*fromuserswhereagenotin(23,26,32) 5.7统计总数(COUNT) print(db.users.count())#selectcount(*)fromusers print(db.users.find({"age":{"$gt":30}}).count())#selectcount(*)fromuserswhereage>30 5.8OR foruindb.users.find({"$or":[{"age":25},{"age":28}]}): print(u)#select*from集合名where键1=值1or键1=值2 foruindb.users.find({"$or":[{"age":{"$lte":23}},{"age":{"$gte":33}}]}): print(u)#select*from集合名where键1<=值1or键1>=值2 6.是否存在(exists) db.users.find({sex:{$exists:True}})#select*from集合名whereexists键1 db.users.find({sex:{$exists:False}})#select*from集合名wherenotexists键1 7.正则表达式查询 foruindb.users.find({"name":{"$regex":r"(?i)user[135]"}},["name"]): print(u)#查询出name为user1,user3,user5 8.多级路径的元素值匹配Document采取JSON-like这种层级结构,因此我们可以直接用嵌入(Embed)代替传统关系型数据库的关联引用(Reference)。
MongoDB支持以"."分割的namespace路径,条件表达式中的多级路径须用引号 #如果键里面包含数组,只需简单匹配数组属性是否包含该元素即可查询出来 db.集合名.find_one({address:"address1"})#address是个数组,匹配时仅需包含有即可 #查询结果如:{"_id":ObjectId("4c479885089df9b53474170a"),"name":"user1","address":["address1","address2"]} #条件表达式中的多级路径须用引号,以"."分割 u=db.集合名.find_one({"im.qq":12345678}) #查询结果如:{"_id":ObjectId("4c479885089df9b53474170a"),"name":"user1","im":{"msn":"[emailprotected]","qq":12345678}} print(u)[im][msn]#显示:[emailprotected] #多级路径的更新 db.集合名.update({"im.qq":12345678},{$set:{"im.qq":12345}}) #查询包含特定键的 foruindb.users.find({"im.qq":{$exists:True}},{"im.qq":1}): print(u) #显示如:{"_id":ObjectId("4c479885089df9b53474170a"),"im":{"qq":12345}} foruindb.users.find({data:"abc"}): print(u) #显示如:{"_id":ObjectId("4c47a481b48cde79c6780df5"),"name":"user8","data":[{"a":1,"b":10},3,"abc"]} foruindb.users.find({data:{$elemMatch:{a:1,b:{$gt:5}}}}): print(u) #显示如:{"_id":ObjectId("4c47a481b48cde79c6780df5"),"name":"user8","data":[{"a":1,"b":10},3,"abc"]} {data:"abc"}仅简单匹配数组属性是否包含该元素。$elemMatch则可以处理更复杂的元素查找条件。当然也可以写成如下方式: db.集合名.find({"data.a":1,"data.b":{$gt:5}}) 对数组,还可以直接使用序号进行操作: db.集合名.find({"data.1":3})#序号从0开始 #如集合的一列内容 {"classifyid":"test1", "keyword":[ {"name":test1,#将修改此值为test5(数组下标从0开始,下标也是用点) "frequence":21, }, {"name":test2,#子表的查询,会匹配到此值 "frequence":50, }, ] } #子表的修改(子表的其它内容不变) db.集合名.update({"classifyid":"test1"},{"$set":{"keyword.0.name":test5}}) #子表的查询 db.集合名.find({"classifyid":"test1","keyword.0.name":"test2"}) 6.操作(1)$all:判断数组属性是否包含全部条件。
db.users.insert({name:"user3",data:[1,2,3,4,5,6,7]}) db.users.insert({name:"user4",data:[1,2,3]}) foruindb.users.find({data:{$all:[2,3,4]}}): print(u) #显示:{"_id":ObjectId("4c47a133b48cde79c6780df0"),"name":"user3","data":[1,2,3,4,5,6,7]}注意和$in的区别。$in是检查目标属性值是条件表达式中的一员,而$all则要求属性值包含全部条件元素。
(2)$size:匹配数组属性元素数量。
foruindb.users.find({data:{$size:3}}): print(u) #只显示匹配此数组数量的:{"_id":ObjectId("4c47a13bb48cde79c6780df1"),"name":"user4","data":[1,2,3]}(3)$type:判断属性类型。
foruindb.users.find({t:{$type:1}}): print(u)#查询数字类型的 foruindb.users.find({t:{$type:2}}): print(u)#查询字符串类型的类型值:
double:1
string:2
object:3
array:4
binarydata:5
objectid:7
boolean:8
date:9
null:10
regularexpression:11
javascriptcode:13
symbol:14
javascriptcodewithscope:15
32-bitinteger:16
timestamp:17
64-bitinteger:18
minkey:255
maxkey:127(4)$not:取反,表示返回条件不成立的文档。
似乎只能跟正则和$mod一起使用????
还不知如何使用(5)$unset:和$set相反,表示移除文档属性。
foruindb.users.find({name:"user1"}): print(u) #显示如:{"_id":ObjectId("4c479885089df9b53474170a"),"name":"user1","age":15,"address":["address1","address2"]} db.users.update({name:"user1"},{$unset:{address:1,age:1}}) foruindb.users.find({name:"user1"}): print(u) #显示如:{"_id":ObjectId("4c479885089df9b53474170a"),"name":"user1"}(6)$push:和$pushAll都是向数组属性添加元素。好像两者没啥区别
foruindb.users.find({name:"user1"}): print(u) #显示如:{"_id":ObjectId("4c479885089df9b53474170a"),"age":15,"name":"user1"} db.users.update({name:"user1"},{$push:{data:1}}) foruindb.users.find({name:"user1"}): print(u) #显示如:{"_id":ObjectId("4c479885089df9b53474170a"),"age":15,"data":[1],"name":"user1"} db.users.update({name:"user1"},{$pushAll:{data:[2,3,4,5]}}) foruindb.users.find({name:"user1"}): print(u) #显示如:{"_id":ObjectId("4c479885089df9b53474170a"),"age":15,"data":[1,2,3,4,5],"name":"user1"}(7)$addToSet:和$push类似,不过仅在该元素不存在时才添加(Set表示不重复元素集合)。
db.users.update({name:"user2"},{$unset:{data:1}}) db.users.update({name:"user2"},{$addToSet:{data:1}}) db.users.update({name:"user2"},{$addToSet:{data:1}}) foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c479896089df9b53474170b"),"data":[1],"name":"user2"} db.users.update({name:"user2"},{$push:{data:1}}) foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c479896089df9b53474170b"),"data":[1,1],"name":"user2"} 要添加多个元素,使用$each。 db.users.update({name:"user2"},{$addToSet:{data:{$each:[1,2,3,4]}}}) foruindb.users.find({name:"user2"}): print(u) #显示:{age:12,_id:ObjectId(4c479896089df9b53474170b),data:[1,1,2,3,4],name:user2} #貌似不会自动删除重复(8)$each添加多个元素用。
db.users.update({name:"user2"},{$unset:{data:1}}) db.users.update({name:"user2"},{$addToSet:{data:1}}) foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c479896089df9b53474170b"),"data":[1],"name":"user2"} db.users.update({name:"user2"},{$addToSet:{data:{$each:[1,2,3,4]}}}) foruindb.users.find({name:"user2"}): print(u) #显示:{age:12,_id:ObjectId(4c479896089df9b53474170b),data:[1,2,3,4],name:user2} db.users.update({name:"user2"},{$addToSet:{data:[1,2,3,4]}}) foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c479896089df9b53474170b"),"data":[1,2,3,4,[1,2,3,4]],"name":"user2"} db.users.update({name:"user2"},{$unset:{data:1}}) db.users.update({name:"user2"},{$addToSet:{data:[1,2,3,4]}}) foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c47a133b48cde79c6780df0"),"data":[[1,2,3,4]],"name":"user2"}(9)$pop:移除数组属性的元素(按数组下标移除),$pull按值移除,$pullAll移除所有符合提交的元素。
db.users.update({name:"user2"},{$unset:{data:1}}) db.users.update({name:"user2"},{$addToSet:{data:{$each:[1,2,3,4,5,6,7,2,3]}}}) foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c47a133b48cde79c6780df0"),"data":[1,2,3,4,5,6,7,2,3],"name":"user2"} db.users.update({name:"user2"},{$pop:{data:1}})#移除最后一个元素 foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c47a133b48cde79c6780df0"),"data":[1,2,3,4,5,6,7,2],"name":"user2"} db.users.update({name:"user2"},{$pop:{data:-1}})#移除第一个元素 foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c47a133b48cde79c6780df0"),"data":[2,3,4,5,6,7,2],"name":"user2"} db.users.update({name:"user2"},{$pull:{data:2}})#移除全部2 foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c47a133b48cde79c6780df0"),"data":[3,4,5,6,7],"name":"user2"} db.users.update({name:"user2"},{$pullAll:{data:[3,5,6]}})#移除3,5,6 foruindb.users.find({name:"user2"}): print(u) #显示:{"_id":ObjectId("4c47a133b48cde79c6780df0"),"data":[4,7],"name":"user2"}(10)$where:用JS代码来代替有些丑陋的$lt、$gt。
MongoDB内置了JavascriptEngine(SpiderMonkey)。可直接使用JSExpression,甚至使用JSFunction写更复杂的CodeBlock。 db.users.remove()#删除集合里的所有记录 foriinrange(10): db.users.insert({name:"user"+str(i),age:i}) foruindb.users.find(): print(u)显示如下:
{"_id":ObjectId("4c47b3372a9b2be866da226e"),"name":"user0","age":0}
{"_id":ObjectId("4c47b3372a9b2be866da226f"),"name":"user1","age":1}
{"_id":ObjectId("4c47b3372a9b2be866da2270"),"name":"user2","age":2}
{"_id":ObjectId("4c47b3372a9b2be866da2271"),"name":"user3","age":3}
{"_id":ObjectId("4c47b3372a9b2be866da2272"),"name":"user4","age":4}
{"_id":ObjectId("4c47b3372a9b2be866da2273"),"name":"user5","age":5}
{"_id":ObjectId("4c47b3372a9b2be866da2274"),"name":"user6","age":6}
{"_id":ObjectId("4c47b3372a9b2be866da2275"),"name":"user7","age":7}
{"_id":ObjectId("4c47b3372a9b2be866da2276"),"name":"user8","age":8}
{"_id":ObjectId("4c47b3372a9b2be866da2277"),"name":"user9","age":9} foruindb.users.find({"$where":"this.age>7||this.age<3"}): print(u)显示如下:
{age:0.0,_id:ObjectId(4c47b3372a9b2be866da226e),name:user0}
{age:1.0,_id:ObjectId(4c47b3372a9b2be866da226f),name:user1}
{age:2.0,_id:ObjectId(4c47b3372a9b2be866da2270),name:user2}
{age:8.0,_id:ObjectId(4c47b3372a9b2be866da2276),name:user8}
{age:9.0,_id:ObjectId(4c47b3372a9b2be866da2277),name:user9} foruindb.users.find().where("this.age>7||this.age<3"): print(u)显示如下:
{age:0.0,_id:ObjectId(4c47b3372a9b2be866da226e),name:user0}
{age:1.0,_id:ObjectId(4c47b3372a9b2be866da226f),name:user1}
{age:2.0,_id:ObjectId(4c47b3372a9b2be866da2270),name:user2}
{age:8.0,_id:ObjectId(4c47b3372a9b2be866da2276),name:user8}
{age:9.0,_id:ObjectId(4c47b3372a9b2be866da2277),name:user9} #使用自定义的function,javascript语法的 foruindb.users.find().where("function(){returnthis.age>7||this.age<3;}"): print(u)显示如下:
{age:0.0,_id:ObjectId(4c47b3372a9b2be866da226e),name:user0}
{age:1.0,_id:ObjectId(4c47b3372a9b2be866da226f),name:user1}
{age:2.0,_id:ObjectId(4c47b3372a9b2be866da2270),name:user2}
{age:8.0,_id:ObjectId(4c47b3372a9b2be866da2276),name:user8}
{age:9.0,_id:ObjectId(4c47b3372a9b2be866da2277),name:user9}本文内容总结:
原文链接:https://www.cnblogs.com/hhh5460/p/5838516.html